Sep 01 01:53:34 devstack cinder-volume[75701]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:53:34 devstack cinder-volume[75701]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:53:34 devstack cinder-volume[75701]: we strongly recommend against using it for new projects. Sep 01 01:53:34 devstack cinder-volume[75701]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:53:34 devstack cinder-volume[75701]: framework. For more detail see Sep 01 01:53:34 devstack cinder-volume[75701]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:53:34 devstack cinder-volume[75701]: import eventlet # noqa Sep 01 01:53:36 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:53:36 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:53:36 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:53:37 devstack cinder-volume[75701]: INFO dbcounter [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Registered counter for database cinder Sep 01 01:53:37 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG dbcounter [-] [75701] Writer thread running {{(pid=75701) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.rpc [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.rpc [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Determined volume DB was empty at startup. Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG cinder.volume.manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75701) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:53:38 devstack cinder-volume[75701]: WARNING stevedore.named [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:53:38 devstack cinder-volume[75701]: WARNING castellan.key_manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:53:38 devstack cinder-volume[75701]: WARNING cinder.keymgr.conf_key_mgr [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG cinder.volume.drivers.lvm [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75701) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_concurrency.processutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75701) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_concurrency.processutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=75701) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.rpc [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.rpc [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:53:38 devstack cinder-volume[75701]: WARNING stevedore.named [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:53:38 devstack cinder-volume[75701]: WARNING castellan.key_manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:53:38 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:53:38 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Starting 1 workers Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Started child 75855 {{(pid=75701) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Full set of CONF: {{(pid=75701) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] ******************************************************************************** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Configuration options gathered from: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:53:38 devstack cinder-volume[75855]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] ================================================================================ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] allow_availability_zone_fallback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] allow_compression_on_image_upload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] allowed_direct_url_schemes = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] api_rate_limit = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] auth_strategy = keystone {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] az_cache_duration = 3600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_host = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_stats_polling_interval = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backup_api_class = cinder.backup.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backup_name_template = backup-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backup_use_same_host = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backup_use_temp_snapshot = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] chap_username = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_internal_tenant_project_id = 898892c379004b71bf48d4ccef2bab2f {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_internal_tenant_user_id = bf577d6060624817bbb62fb109e6f970 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cloned_volume_same_az = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cluster = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] compression_format = gzip {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] compute_api_class = cinder.compute.nova.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] config_dir = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] config_source = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] control_exchange = openstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] debug = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] default_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] default_group_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] default_volume_type = lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_ssl_cert_verify = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] driver_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] enable_force_upload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] enable_new_services = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] enable_unsupported_driver = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] enforce_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_api_insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_api_ssl_compression = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_ca_certificates_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_catalog_info = image:glance:publicURL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_num_retries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance_request_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] graceful_shutdown_timeout = 5 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] group_api_class = cinder.group.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] host = devstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_compress_on_upload = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_conversion_address_space_limit = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_conversion_cpu_limit = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_conversion_disable = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_upload_use_cinder_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_upload_use_internal_tenant = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_volume_cache_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_volume_cache_max_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] image_volume_cache_max_size_gb = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] init_host_max_objects_retrieval = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] instance_format = [instance: %(uuid)s] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iscsi_target_flags = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iscsi_write_cache = on {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iser_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75855]: INFO cinder.volume.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iser_ip_address = 192.168.122.6 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iser_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_color = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_config_append = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_options = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_rotate_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_rotate_interval_type = days {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] log_rotation_type = none {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] max_age = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] max_logfile_count = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] max_logfile_size_mb = 200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] max_over_subscription_ratio = 20.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] message_reap_interval = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] message_ttl = 2592000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] migration_create_volume_timeout_secs = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] monkey_patch = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] monkey_patch_modules = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] my_ip = 192.168.122.6 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] no_snapshot_gb_quota = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] num_iser_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] num_shell_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] num_volume_device_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] nvmeof_conn_info_version = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] nvmet_ns_id = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] nvmet_port_id = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:38 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_max_limit = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_ext_list = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_listen_port = 8776 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] osapi_volume_workers = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] per_volume_size_limit = -1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] periodic_fuzzy_delay = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] periodic_interval = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] public_endpoint = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] publish_errors = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_backup_gigabytes = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_backups = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_gigabytes = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_groups = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_snapshots = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] quota_volumes = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] rate_limit_burst = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] rate_limit_except_level = CRITICAL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] rate_limit_interval = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] reinit_driver_count = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] report_discard_supported = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:38 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] report_interval = 120 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] reservation_clean_interval = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] reservation_expire = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] reserved_image_namespaces = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] reserved_percentage = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] rpc_response_timeout = 120 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] run_external_periodic_tasks = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] scst_target_driver = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_down_time = 720 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] shell_completion = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] snapshot_name_template = snapshot-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] snapshot_same_host = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] state_path = /opt/stack/data/cinder {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] storage_availability_zone = nova {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] storage_protocol = iSCSI {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] syslog_log_facility = LOG_USER {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_helper = lioadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_ip_address = 192.168.122.6 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] target_secondary_ip_addresses = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] transport_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] until_refresh = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_chap_auth = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_default_quota_class = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_journal = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_json = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_stderr = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] use_syslog = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] verify_glance_signatures = enabled {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_api_class = cinder.volume.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_clear_size = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_copy_bps_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_dd_blocksize = 1M {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_name_template = volume-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_service_inithost_offload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volume_usage_audit_period = month {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] zoning_mode = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_concurrency.disable_process_locking = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack sudo[75859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[75859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.auth_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.cache = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.include_service_catalog = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.interface = public {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcache_username = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.service_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.backend = dogpile.cache.null {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.backend_argument = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.backend_expiration_time = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.config_prefix = cache.oslo {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.debug_cache_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.enable_retry_client = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.enable_socket_keepalive = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.expiration_time = 600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.hashclient_retry_attempts = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_dead_retry = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_pool_maxsize = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_sasl_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.proxies = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.redis_db = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.redis_server = localhost:6379 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.retry_attempts = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.retry_delay = 0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.socket_keepalive_count = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.socket_keepalive_idle = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.socket_keepalive_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.socket_timeout = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.tls_allowed_ciphers = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.tls_cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.tls_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.tls_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.tls_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cache.username = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] coordination.backend_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.asyncio_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.asyncio_slave_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.backend = sqlalchemy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.connection_debug = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.connection_parameters = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.connection_recycle_time = 3600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.connection_trace = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.db_inc_retry_interval = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.db_max_retries = 20 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.db_max_retry_interval = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.db_retry_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.max_overflow = 50 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.max_pool_size = 5 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.max_retries = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.mysql_wsrep_sync_wait = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.pool_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.retry_interval = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.slave_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.sqlite_synchronous = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.synchronous_reader = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] database.use_db_reconnect = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_tracing.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.connection_string = messaging:// {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.es_doc_type = notification {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.es_scroll_size = 10000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.es_scroll_time = 2m {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.filter_error_trace = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.hmac_keys = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.sentinel_service_name = mymaster {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.socket_timeout = 0.1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.trace_requests = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler.trace_sqlalchemy = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler_jaeger.process_tags = {} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler_jaeger.service_name_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] profiler_otlp.service_name_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.enforce_new_defaults = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.policy_default_rule = default {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.policy_file = policy.yaml {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.group = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.helper_command = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] privsep_osbrick.user = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.group = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.helper_command = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] cinder_sys_admin.user = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.send_service_user_token = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] service_user.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] glance.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.chap_username = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.driver_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.extra_capabilities = {} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iscsi_target_flags = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iscsi_write_cache = on {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iser_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iser_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.lvm_share_target = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.lvm_type = auto {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.num_shell_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.report_discard_supported = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.reserved_percentage = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.unique_fqdn_network = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.use_chap_auth = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_clear_size = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_reports.file_event_handler = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_reports.log_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.backend_host = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.chap_username = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.extra_capabilities = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iser_helper = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iser_ip_address = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iser_port = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.lvm_share_target = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.lvm_type = auto {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.num_shell_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.report_discard_supported = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.reserved_percentage = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.scst_target_driver = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.storage_protocol = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_helper = lioadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_ip_address = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.use_chap_auth = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_clear_size = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] lvmdriver-1.volumes_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_notifications.driver = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_notifications.retry = -1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] key_manager.fixed_key = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.barbican_api_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.barbican_endpoint = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.barbican_endpoint_type = public {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.barbican_region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.number_of_retries = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.retry_delay = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.send_service_user_token = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.verify_ssl = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican.verify_ssl_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.auth_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] barbican_service_user.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.approle_role_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.approle_secret_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.auth_method = approle {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.auth_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.kv_mountpoint = secret {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.kv_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.kv_version = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.root_token_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.ssl_ca_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.token_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.token_role = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:53:39 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] ******************************************************************************** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:53:39 devstack sudo[75859]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[75863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:39 devstack sudo[75863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:39 devstack sudo[75863]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.360s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:53:39 devstack cinder-volume[75855]: INFO cinder.brick.local_dev.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[75897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:39 devstack sudo[75897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:40 devstack sudo[75897]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG cinder.brick.local_dev.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75855) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack sudo[76040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:40 devstack sudo[76040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:40 devstack sudo[76040]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:40 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:40 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack sudo[76358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:53:40 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.284s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[76473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:41 devstack sudo[76473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[76473]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[76476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:41 devstack sudo[76476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[76476]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[76560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:41 devstack sudo[76560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[76560]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[76563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:41 devstack sudo[76563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:42 devstack sudo[76563]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:42 devstack sudo[76602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:42 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:42 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[75855]: INFO cinder.volume.drivers.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:42 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:42 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:42 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:53:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:42 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:42 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:43 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:43 devstack sudo[76703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:43 devstack sudo[76703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:43 devstack sudo[76703]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:43 devstack sudo[76706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:43 devstack sudo[76706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:43 devstack sudo[76706]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:43 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:43 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:43 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:44 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:44 devstack cinder-volume[75855]: INFO cinder.volume.driver [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG cinder.volume.driver [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75855) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_db.sqlalchemy.engines [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writer thread running {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG cinder.db.api [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Building query based on filter {{(pid=75855) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG cinder.image.image_utils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75855) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:53:44 devstack cinder-volume[75855]: INFO cinder.keymgr.migration [None req-541fbd21-d34a-4d9d-b41d-eca83f734e9c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:44 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:44 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:44 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:44 devstack sudo[76721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:44 devstack sudo[76721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:44 devstack sudo[76721]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:44 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:44 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:44 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:45 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:45 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:45 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:45 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG cinder.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Notifying Schedulers of capabilities ... {{(pid=75855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:45 devstack cinder-volume[75855]: INFO cinder.volume.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Driver initialization completed successfully. Sep 01 01:53:45 devstack cinder-volume[75855]: INFO cinder.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Initiating service 2 cleanup Sep 01 01:53:45 devstack cinder-volume[75855]: INFO cinder.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Service 2 cleanup completed. Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG cinder.service [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Creating RPC server for service cinder-volume {{(pid=75855) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG cinder.service [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75855) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:53:45 devstack cinder-volume[75855]: INFO cinder.volume.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:45 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:45 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:45 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:45 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:45 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:45 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:46 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:46 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:46 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:46 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:46 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:46 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:46 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:46 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:46 devstack sudo[76745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:46 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:46 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:46 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:46 devstack cinder-volume[75855]: INFO cinder.volume.manager [None req-0e8070d0-221f-433d-a877-d1e2b8a841fa None None] Driver post RPC initialization completed successfully. Sep 01 01:53:48 devstack cinder-volume[75701]: DEBUG dbcounter [-] [75701] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75701) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:55 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:56 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:41 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:41 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:41 devstack sudo[78681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:41 devstack sudo[78681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:42 devstack sudo[78681]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:42 devstack sudo[78684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:42 devstack sudo[78684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:42 devstack sudo[78684]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:42 devstack sudo[78687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:42 devstack sudo[78687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:42 devstack sudo[78687]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:42 devstack sudo[78690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:42 devstack sudo[78690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:42 devstack sudo[78690]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG cinder.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Notifying Schedulers of capabilities ... {{(pid=75855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager._thread_info {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread count: 6 {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:54:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread info: [<_MainThread(MainThread, started 126646251171968)>, , , , , ] {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:55:41 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:41 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:41 devstack sudo[82403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:41 devstack sudo[82403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:42 devstack sudo[82403]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:42 devstack sudo[82407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:42 devstack sudo[82407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:42 devstack sudo[82407]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:42 devstack sudo[82411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:42 devstack sudo[82411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:42 devstack sudo[82411]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:42 devstack sudo[82414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:42 devstack sudo[82414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:42 devstack sudo[82414]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:42 devstack cinder-volume[75855]: DEBUG cinder.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Notifying Schedulers of capabilities ... {{(pid=75855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:55:56 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:41 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:41 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:56:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:41 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:56:41 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:42 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:42 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:42 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:42 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:42 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:56:42 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:42 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:42 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:42 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:42 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG cinder.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Notifying Schedulers of capabilities ... {{(pid=75855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager._thread_info {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread count: 6 {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:56:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread info: [<_MainThread(MainThread, started 126646251171968)>, , , , , ] {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:57:41 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:41 devstack cinder-volume[75855]: DEBUG cinder.volume.drivers.lvm [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Updating volume stats {{(pid=75855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:57:41 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:57:41 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:42 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:57:42 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:42 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_concurrency.processutils [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG cinder.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Notifying Schedulers of capabilities ... {{(pid=75855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG oslo_service.periodic_task [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] Running periodic task VolumeManager._thread_info {{(pid=75855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread count: 6 {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:57:42 devstack cinder-volume[75855]: DEBUG cinder.volume.manager [None req-e9cd83df-8fe0-4085-a3fb-f67d3c8d84dc None None] thread info: [<_MainThread(MainThread, started 126646251171968)>, , , , , ] {{(pid=75855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:57:56 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writing DB stats cinder:SELECT=1 {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:56 devstack cinder-volume[75855]: DEBUG dbcounter [-] [75855] Writing DB stats cinder:UPDATE=1 {{(pid=75855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:11 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Caught SIGTERM, stopping children Sep 01 01:58:11 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Acquiring lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:11 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Acquired lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:11 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Releasing lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:11 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Stop services. {{(pid=75701) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:58:11 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Killing children. {{(pid=75701) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:58:11 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Waiting on 1 children to exit Sep 01 01:58:16 devstack cinder-volume[75855]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 01 01:58:17 devstack cinder-volume[86301]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:58:17 devstack cinder-volume[86301]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:58:17 devstack cinder-volume[86301]: we strongly recommend against using it for new projects. Sep 01 01:58:17 devstack cinder-volume[86301]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:58:17 devstack cinder-volume[86301]: framework. For more detail see Sep 01 01:58:17 devstack cinder-volume[86301]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:58:17 devstack cinder-volume[86301]: import eventlet # noqa Sep 01 01:58:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:20 devstack cinder-volume[86301]: INFO dbcounter [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Registered counter for database cinder Sep 01 01:58:20 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writer thread running {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:58:20 devstack cinder-volume[86301]: INFO cinder.rpc [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:58:20 devstack cinder-volume[86301]: INFO cinder.rpc [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:58:20 devstack cinder-volume[75855]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Acquiring lock "singleton_lock" {{(pid=75855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:20 devstack cinder-volume[75855]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Acquired lock "singleton_lock" {{(pid=75855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:20 devstack cinder-volume[75855]: DEBUG oslo_concurrency.lockutils [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Releasing lock "singleton_lock" {{(pid=75855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:20 devstack cinder-volume[75855]: WARNING amqp [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:58:20 devstack cinder-volume[75855]: WARNING amqp [None req-44875d28-135c-42a7-a33d-dda38501c565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:58:20 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Determined volume DB was empty at startup. Sep 01 01:58:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86301) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:58:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:58:20 devstack cinder-volume[86301]: WARNING stevedore.named [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:58:20 devstack cinder-volume[86301]: WARNING castellan.key_manager [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:58:20 devstack cinder-volume[86301]: WARNING cinder.keymgr.conf_key_mgr [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:58:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:58:20 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:21 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Starting 1 workers Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Started child 86521 {{(pid=86301) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Full set of CONF: {{(pid=86301) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Configuration options gathered from: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] ================================================================================ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] allow_availability_zone_fallback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] allow_compression_on_image_upload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] allowed_direct_url_schemes = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] api_rate_limit = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] auth_strategy = keystone {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86521]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_host = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_stats_polling_interval = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backup_api_class = cinder.backup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backup_name_template = backup-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backup_use_same_host = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backup_use_temp_snapshot = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] chap_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] chap_username = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_internal_tenant_project_id = 898892c379004b71bf48d4ccef2bab2f {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_internal_tenant_user_id = bf577d6060624817bbb62fb109e6f970 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cluster = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] compression_format = gzip {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] compute_api_class = cinder.compute.nova.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] config_dir = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] config_source = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] control_exchange = openstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] debug = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] default_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] default_group_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] default_volume_type = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] disk_geometry = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_client_cert = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_ssl_cert_verify = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] driver_use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] enable_new_services = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] enable_unsupported_driver = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] enabled_backends = ['QuobyteHD'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] filter_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_api_insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_api_ssl_compression = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_ca_certificates_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_catalog_info = image:glance:publicURL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_num_retries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance_request_timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] goodness_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] graceful_shutdown_timeout = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] group_api_class = cinder.group.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] host = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_compress_on_upload = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_conversion_address_space_limit = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_conversion_cpu_limit = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_conversion_disable = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_volume_cache_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_volume_cache_max_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] init_host_max_objects_retrieval = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] instance_format = [instance: %(uuid)s] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iscsi_target_flags = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iscsi_write_cache = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iser_helper = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iser_ip_address = 192.168.122.6 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iser_port = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_color = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_config_append = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_dir = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_options = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_rotate_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_rotate_interval_type = days {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] log_rotation_type = none {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] max_age = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] max_logfile_count = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] max_logfile_size_mb = 200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] max_over_subscription_ratio = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] message_reap_interval = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] message_ttl = 2592000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] migration_create_volume_timeout_secs = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] monkey_patch = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.remotefs [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86521) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] monkey_patch_modules = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] my_ip = 192.168.122.6 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] no_snapshot_gb_quota = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] num_iser_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] num_shell_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] num_volume_device_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] nvmeof_conn_info_version = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] nvmet_ns_id = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] nvmet_port_id = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_max_limit = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_ext_list = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_listen_port = 8776 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] osapi_volume_workers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] per_volume_size_limit = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] periodic_fuzzy_delay = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] periodic_interval = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] public_endpoint = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] publish_errors = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_backup_gigabytes = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_backups = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_gigabytes = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_groups = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_snapshots = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] quota_volumes = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] rate_limit_burst = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] rate_limit_except_level = CRITICAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] rate_limit_interval = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] reinit_driver_count = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] replication_device = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] report_discard_supported = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] report_interval = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] reservation_clean_interval = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] reservation_expire = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] reserved_image_namespaces = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] reserved_percentage = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] rpc_response_timeout = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] run_external_periodic_tasks = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] scst_target_driver = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_down_time = 720 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] shell_completion = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] snapshot_name_template = snapshot-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] state_path = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] storage_availability_zone = nova {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] storage_protocol = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] syslog_log_facility = LOG_USER {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_helper = lioadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_ip_address = 192.168.122.6 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_port = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_protocol = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] target_secondary_ip_addresses = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] trace_flags = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] transport_url = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] until_refresh = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_chap_auth = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_default_quota_class = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_journal = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_json = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_stderr = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] use_syslog = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] verify_glance_signatures = enabled {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_api_class = cinder.volume.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_backend_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_clear = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_clear_ionice = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_clear_size = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_copy_bps_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_dd_blocksize = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_name_template = volume-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_service_inithost_offload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volume_usage_audit_period = month {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] zoning_mode = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_concurrency.disable_process_locking = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.auth_type = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.auth_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.cache = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.include_service_catalog = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.interface = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcache_username = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.region_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.service_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.backend = dogpile.cache.null {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.backend_argument = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.backend_expiration_time = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.config_prefix = cache.oslo {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.debug_cache_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.enable_retry_client = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.enable_socket_keepalive = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.expiration_time = 600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.hashclient_retry_attempts = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_dead_retry = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_pool_maxsize = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_sasl_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.proxies = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.redis_db = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.redis_server = localhost:6379 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.retry_attempts = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.retry_delay = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.socket_keepalive_count = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86521) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.socket_keepalive_idle = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.socket_keepalive_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.socket_timeout = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.tls_allowed_ciphers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86521]: WARNING cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:58:21 devstack cinder-volume[86521]: WARNING cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Running cmd (subprocess): mount.quobyte {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.tls_cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.tls_certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.tls_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.tls_keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cache.username = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] coordination.backend_url = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.asyncio_connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.asyncio_slave_connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.backend = sqlalchemy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.connection_debug = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.connection_parameters = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.connection_recycle_time = 3600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.connection_trace = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.db_inc_retry_interval = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.db_max_retries = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.db_max_retry_interval = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.db_retry_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.max_overflow = 50 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.max_pool_size = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.max_retries = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.mysql_wsrep_sync_wait = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.pool_timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.retry_interval = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.slave_connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.sqlite_synchronous = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.synchronous_reader = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] database.use_db_reconnect = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_tracing.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.connection_string = messaging:// {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.es_doc_type = notification {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.es_scroll_size = 10000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.es_scroll_time = 2m {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.filter_error_trace = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.hmac_keys = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.socket_timeout = 0.1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.trace_requests = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler.trace_sqlalchemy = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler_jaeger.process_tags = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler_jaeger.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] profiler_otlp.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.enforce_new_defaults = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.policy_default_rule = default {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.policy_file = policy.yaml {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.group = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] privsep_osbrick.user = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.group = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] cinder_sys_admin.user = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.auth_type = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.send_service_user_token = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] service_user.timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.auth_type = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.region_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] glance.timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.chap_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.chap_username = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.disk_geometry = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_client_cert = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.driver_use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.extra_capabilities = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.filter_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.goodness_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iscsi_target_flags = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iscsi_write_cache = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iser_helper = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iser_port = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_host = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_login = admin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_mount_options = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_private_key = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_share_path = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.num_shell_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack quobyte-client[86524]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.quobyte_volume_url = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.replication_device = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.report_discard_supported = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.reserved_percentage = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack quobyte-client[86524]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_helper = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_port = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_protocol = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.trace_flags = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.unique_fqdn_network = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.use_chap_auth = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_backend_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_clear = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_clear_ionice = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_clear_size = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_reports.file_event_handler = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:21 devstack cinder-volume[86521]: INFO cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 ... Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 -c /etc/quobyte/client-cinder.cfg {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_reports.log_dir = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.backend_host = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.chap_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.chap_username = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.chiscsi_conf = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.disk_geometry = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_client_cert = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.driver_use_ssl = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.extra_capabilities = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.filter_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.goodness_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iser_helper = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iser_ip_address = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iser_port = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.iser_target_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_host = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_login = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_mount_options = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_private_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_share_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_ssh_port = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.num_shell_tries = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.nvmet_port_id = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.replication_device = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.report_discard_supported = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.reserved_percentage = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.scst_target_driver = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.storage_protocol = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_helper = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_ip_address = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_port = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_protocol = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.trace_flags = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.use_chap_auth = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_clear = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_clear_size = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] QuobyteHD.volumes_dir = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 -c /etc/quobyte/client-cinder.cfg Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_notifications.driver = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_notifications.retry = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] key_manager.fixed_key = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.barbican_api_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.barbican_endpoint = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.barbican_endpoint_type = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.barbican_region_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.number_of_retries = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.retry_delay = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.send_service_user_token = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.verify_ssl = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican.verify_ssl_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.auth_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] barbican_service_user.timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.approle_role_id = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.approle_secret_id = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.auth_method = approle {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.auth_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.kv_mountpoint = secret {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.kv_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.kv_version = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.root_token_id = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.ssl_ca_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.timeout = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.token_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.token_role = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:21 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:58:21 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[86521]: INFO cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 succeeded Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:21 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:21 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.238s {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.volume.driver [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.volume.driver [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86521) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_db.sqlalchemy.engines [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG dbcounter [-] [86521] Writer thread running {{(pid=86521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.db.api [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Building query based on filter {{(pid=86521) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.image.image_utils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86521) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.keymgr.migration [None req-e1f479fe-9326-4e40-b35e-d96fb708e6f5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:22 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.243s {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Notifying Schedulers of capabilities ... {{(pid=86521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Driver initialization completed successfully. Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Initiating service 3 cleanup Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Service 3 cleanup completed. Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.service [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Creating RPC server for service cinder-volume {{(pid=86521) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.service [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86521) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG cinder.volume.drivers.quobyte [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:22 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[86521]: DEBUG oslo_concurrency.processutils [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.263s {{(pid=86521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-12bcddcb-2648-4c56-b28c-fec0949cb26a None None] Driver post RPC initialization completed successfully. Sep 01 01:58:26 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Caught SIGTERM, stopping children Sep 01 01:58:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Acquiring lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Acquired lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Releasing lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:26 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Stop services. {{(pid=86301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:58:26 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Killing children. {{(pid=86301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:58:26 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Waiting on 1 children to exit Sep 01 01:58:26 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Acquiring lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:26 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Acquired lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:26 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Releasing lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:26 devstack cinder-volume[86521]: WARNING amqp [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:58:26 devstack cinder-volume[86521]: WARNING amqp [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:58:26 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-5e788b13-2724-4615-8b2b-ab9125ce4994 None None] Child 86521 exited with status 0 Sep 01 01:58:27 devstack cinder-volume[86835]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:58:27 devstack cinder-volume[86835]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:58:27 devstack cinder-volume[86835]: we strongly recommend against using it for new projects. Sep 01 01:58:27 devstack cinder-volume[86835]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:58:27 devstack cinder-volume[86835]: framework. For more detail see Sep 01 01:58:27 devstack cinder-volume[86835]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:58:27 devstack cinder-volume[86835]: import eventlet # noqa Sep 01 01:58:29 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:58:29 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:58:29 devstack cinder-volume[86835]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:58:30 devstack cinder-volume[86835]: INFO dbcounter [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Registered counter for database cinder Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_db.sqlalchemy.engines [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG dbcounter [-] [86835] Writer thread running {{(pid=86835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:58:30 devstack cinder-volume[86835]: INFO cinder.rpc [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:58:30 devstack cinder-volume[86835]: INFO cinder.rpc [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_db.sqlalchemy.engines [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:30 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Determined volume DB was empty at startup. Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG cinder.volume.manager [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86835) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:58:30 devstack cinder-volume[86835]: WARNING stevedore.named [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:58:30 devstack cinder-volume[86835]: WARNING castellan.key_manager [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:58:30 devstack cinder-volume[86835]: WARNING cinder.keymgr.conf_key_mgr [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:58:30 devstack cinder-volume[86835]: INFO cinder.volume.manager [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_db.sqlalchemy.engines [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:30 devstack cinder-volume[86835]: INFO oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Starting 1 workers Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Started child 86925 {{(pid=86835) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Full set of CONF: {{(pid=86835) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] ******************************************************************************** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] Configuration options gathered from: {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] ================================================================================ {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] allow_availability_zone_fallback = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] allow_compression_on_image_upload = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] allowed_direct_url_schemes = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] api_rate_limit = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] auth_strategy = keystone {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_availability_zone = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_host = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_stats_polling_interval = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backup_api_class = cinder.backup.api.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backup_name_template = backup-%s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backup_use_same_host = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86925]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backup_use_temp_snapshot = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] chap_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] chap_username = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_internal_tenant_project_id = 898892c379004b71bf48d4ccef2bab2f {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_internal_tenant_user_id = bf577d6060624817bbb62fb109e6f970 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cluster = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] compression_format = gzip {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] compute_api_class = cinder.compute.nova.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] config_dir = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] config_source = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] control_exchange = openstack {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] debug = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] default_availability_zone = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] default_group_type = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] default_volume_type = QuobyteHD {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] disk_geometry = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_client_cert = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_client_cert_key = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_data_namespace = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_ssl_cert_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_ssl_cert_verify = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] driver_use_ssl = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] enable_new_services = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] enable_unsupported_driver = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] enabled_backends = ['QuobyteHD'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] enforce_multipath_for_image_xfer = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] filter_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_api_insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_api_ssl_compression = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_ca_certificates_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_catalog_info = image:glance:publicURL {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_num_retries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance_request_timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] goodness_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] graceful_shutdown_timeout = 5 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] group_api_class = cinder.group.api.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] host = devstack {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_compress_on_upload = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_conversion_address_space_limit = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_conversion_cpu_limit = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_conversion_disable = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_upload_use_cinder_backend = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_upload_use_internal_tenant = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_volume_cache_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_volume_cache_max_count = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] image_volume_cache_max_size_gb = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] init_host_max_objects_retrieval = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] instance_format = [instance: %(uuid)s] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iscsi_target_flags = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iscsi_write_cache = on {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iser_helper = tgtadm {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iser_ip_address = 192.168.122.6 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iser_port = 3260 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_color = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_config_append = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_dir = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_options = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_rotate_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_rotate_interval_type = days {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] log_rotation_type = none {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] max_age = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] max_logfile_count = 30 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] max_logfile_size_mb = 200 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] max_over_subscription_ratio = 20.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] message_reap_interval = 86400 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] message_ttl = 2592000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] migration_create_volume_timeout_secs = 300 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] monkey_patch = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] monkey_patch_modules = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] my_ip = 192.168.122.6 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] no_snapshot_gb_quota = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] num_iser_scan_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] num_shell_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] num_volume_device_scan_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] nvmeof_conn_info_version = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] nvmet_ns_id = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] nvmet_port_id = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_max_limit = 1000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_ext_list = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_listen_port = 8776 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_use_ssl = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] osapi_volume_workers = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] per_volume_size_limit = -1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] periodic_fuzzy_delay = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] periodic_interval = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] public_endpoint = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] publish_errors = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_backup_gigabytes = 1000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_backups = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_gigabytes = 1000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_groups = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_snapshots = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] quota_volumes = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] rate_limit_burst = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] rate_limit_except_level = CRITICAL {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] rate_limit_interval = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] reinit_driver_count = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] replication_device = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] report_discard_supported = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] report_interval = 120 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] reservation_clean_interval = 86400 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] reservation_expire = 86400 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] reserved_image_namespaces = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] reserved_percentage = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] rpc_response_timeout = 120 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] run_external_periodic_tasks = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] scst_target_driver = iscsi {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] scst_target_iqn_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_down_time = 720 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] shell_completion = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] snapshot_name_template = snapshot-%s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] split_loggers = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] state_path = /opt/stack/data/cinder {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] storage_availability_zone = nova {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] storage_protocol = iSCSI {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] syslog_log_facility = LOG_USER {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_helper = lioadm {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_ip_address = 192.168.122.6 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_port = 3260 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_protocol = iscsi {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] target_secondary_ip_addresses = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] trace_flags = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] transport_url = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] until_refresh = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_chap_auth = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_default_quota_class = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_journal = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_json = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_multipath_for_image_xfer = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_stderr = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] use_syslog = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] verify_glance_signatures = enabled {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_api_class = cinder.volume.api.API {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_backend_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_clear = zero {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_clear_ionice = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_clear_size = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_copy_bps_limit = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_dd_blocksize = 1M {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_name_template = volume-%s {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_service_inithost_offload = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volume_usage_audit_period = month {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86925) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] zoning_mode = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_concurrency.disable_process_locking = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.auth_section = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.auth_type = password {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.auth_version = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.cache = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.include_service_catalog = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.interface = public {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcache_username = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.region_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.service_type = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.backend = dogpile.cache.null {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.backend_argument = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.backend_expiration_time = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.config_prefix = cache.oslo {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.debug_cache_backend = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.enable_retry_client = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.enable_socket_keepalive = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.expiration_time = 600 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.hashclient_retry_attempts = 2 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_dead_retry = 300 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_pool_maxsize = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_sasl_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.proxies = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.redis_db = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.redis_server = localhost:6379 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.retry_attempts = 2 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.retry_delay = 0.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.socket_keepalive_count = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.socket_keepalive_idle = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.socket_keepalive_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.socket_timeout = 1.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.tls_allowed_ciphers = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.tls_cafile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.tls_certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.tls_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.tls_keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cache.username = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] coordination.backend_url = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.asyncio_connection = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.asyncio_slave_connection = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.backend = sqlalchemy {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.connection = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.connection_debug = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.connection_parameters = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.connection_recycle_time = 3600 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.connection_trace = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.db_inc_retry_interval = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.db_max_retries = 20 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.db_max_retry_interval = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.db_retry_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.max_overflow = 50 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.max_pool_size = 5 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.max_retries = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.mysql_wsrep_sync_wait = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.pool_timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.retry_interval = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.slave_connection = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.sqlite_synchronous = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.synchronous_reader = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] database.use_db_reconnect = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_tracing.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.connection_string = messaging:// {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.es_doc_type = notification {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.es_scroll_size = 10000 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.es_scroll_time = 2m {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.filter_error_trace = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.hmac_keys = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.sentinel_service_name = mymaster {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.socket_timeout = 0.1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.trace_requests = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler.trace_sqlalchemy = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler_jaeger.process_tags = {} {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler_jaeger.service_name_prefix = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] profiler_otlp.service_name_prefix = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.enforce_new_defaults = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.policy_default_rule = default {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.policy_file = policy.yaml {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.group = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.helper_command = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86925) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] privsep_osbrick.user = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:58:30 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.group = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.helper_command = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Running cmd (subprocess): mount.quobyte {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] cinder_sys_admin.user = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.auth_section = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.auth_type = password {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.cafile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.collect_timing = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.send_service_user_token = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.split_loggers = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] service_user.timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.auth_section = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.auth_type = password {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.collect_timing = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.region_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.split_loggers = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] glance.timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.backend_availability_zone = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.chap_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.chap_username = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.disk_geometry = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_client_cert = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_client_cert_key = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_data_namespace = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.driver_use_ssl = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.extra_capabilities = {} {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.filter_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.goodness_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iscsi_target_flags = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iscsi_write_cache = on {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iser_helper = tgtadm {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iser_port = 3260 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_host = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_login = admin {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_mount_options = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_private_key = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_share_path = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.num_shell_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.quobyte_volume_url = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.replication_device = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.report_discard_supported = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.reserved_percentage = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_helper = tgtadm {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_port = 3260 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_protocol = iscsi {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.trace_flags = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.unique_fqdn_network = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.use_chap_auth = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_backend_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_clear = zero {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_clear_ionice = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_clear_size = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_reports.file_event_handler = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_reports.log_dir = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.backend_availability_zone = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.backend_host = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.chap_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack quobyte-client[86934]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.chap_username = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.chiscsi_conf = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.disk_geometry = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_client_cert = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack quobyte-client[86934]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_data_namespace = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.driver_use_ssl = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.extra_capabilities = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.filter_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.goodness_function = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iser_helper = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iser_ip_address = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iser_port = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.iser_target_prefix = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_host = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_login = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_mount_options = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_password = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_private_key = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_share_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_ssh_port = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.num_shell_tries = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.nvmet_port_id = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.replication_device = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.report_discard_supported = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.reserved_percentage = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.scst_target_driver = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.storage_protocol = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_helper = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_ip_address = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_port = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_prefix = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_protocol = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.trace_flags = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.use_chap_auth = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_clear = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_clear_size = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] QuobyteHD.volumes_dir = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_notifications.driver = [] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_notifications.retry = -1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] key_manager.fixed_key = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.barbican_api_version = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.barbican_endpoint = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.barbican_endpoint_type = public {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.barbican_region_name = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.cafile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.collect_timing = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.number_of_retries = 60 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.retry_delay = 1 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.send_service_user_token = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.split_loggers = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.verify_ssl = True {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican.verify_ssl_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.auth_section = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.auth_type = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.cafile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.certfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.collect_timing = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.insecure = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.keyfile = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.split_loggers = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] barbican_service_user.timeout = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.approle_role_id = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.approle_secret_id = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.auth_method = approle {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.auth_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.kv_mountpoint = secret {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.kv_path = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.kv_version = 2 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.namespace = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.root_token_id = **** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.ssl_ca_crt_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.timeout = 60.0 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.token_file = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.token_role = None {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.use_ssl = False {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:58:30 devstack cinder-volume[86835]: DEBUG oslo_service.backend._eventlet.service [None req-3eae83c3-4eab-4714-9307-7bbf44639294 None None] ******************************************************************************** {{(pid=86835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:58:31 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.volume.driver [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.volume.driver [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.039436340332, 'free_capacity_gb': 1774.039436340332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86925) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writer thread running {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.db.api [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Building query based on filter {{(pid=86925) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86925) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.keymgr.migration [None req-38adc5fc-1319-4613-9e6e-b412e125dcd4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:58:31 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:31 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Driver initialization completed successfully. Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Initiating service 3 cleanup Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Service 3 cleanup completed. Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.service [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Creating RPC server for service cinder-volume {{(pid=86925) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.service [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86925) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:58:31 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7eb941d5-9261-481b-9e1e-7daedd96b96c None None] Driver post RPC initialization completed successfully. Sep 01 01:58:40 devstack cinder-volume[86835]: DEBUG dbcounter [-] [86835] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 6 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:40 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 01:59:40 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:41 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 6 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:59:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (98e1241f-87cd-4615-b281-55249e35f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef8a04-60d7-4ae8-9d02-59f9b300b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef8a04-60d7-4ae8-9d02-59f9b300b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-362162516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a35b38-c48a-47f2-8680-07dbfcfc6ffc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:16Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd6901d-9179-4a13-aebf-b70958dbc6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd6901d-9179-4a13-aebf-b70958dbc6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c7b2db-b99b-456f-a0da-93866c5d8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c7b2db-b99b-456f-a0da-93866c5d8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a35b38-c48a-47f2-8680-07dbfcfc6ffc', 'volume_name': 'volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8fe203-ef90-4803-b55b-e084d46134f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8fe203-ef90-4803-b55b-e084d46134f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c6a41-4476-42d5-9a4d-0e0534f25969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Volume 73a35b38-c48a-47f2-8680-07dbfcfc6ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc', 'volume_size': 1} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-362162516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a35b38-c48a-47f2-8680-07dbfcfc6ffc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:16Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Creating volume 73a35b38-c48a-47f2-8680-07dbfcfc6ffc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:15 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:00:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:15 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc 1073741824 Sep 01 02:00:15 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:16 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc 1073741824" returned: 0 in 0.639s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:16 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc Sep 01 02:00:16 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:16 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c6a41-4476-42d5-9a4d-0e0534f25969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4837139f-505c-4519-b201-b18a2f094923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:16 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Volume volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc (73a35b38-c48a-47f2-8680-07dbfcfc6ffc): created successfully Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4837139f-505c-4519-b201-b18a2f094923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (98e1241f-87cd-4615-b281-55249e35f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9a94f90f-5473-4eb2-9b91-4c93c4f706e4 tempest-VolumesTestJSON-90242645 None] Created volume successfully. Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (87002513-52c0-4445-8f76-3d834e8e98b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14b28c9-5e08-4f36-a896-5953d4fe13f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14b28c9-5e08-4f36-a896-5953d4fe13f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-11299330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a26fa3-2d77-49d0-9a34-70bf07d4085b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:19Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89db696-6e22-4cc4-8439-d6f9a9441c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89db696-6e22-4cc4-8439-d6f9a9441c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117e0140-9f0c-46a4-8b6b-377259e8888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117e0140-9f0c-46a4-8b6b-377259e8888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a26fa3-2d77-49d0-9a34-70bf07d4085b', 'volume_name': 'volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0f6f0d-14be-4769-bbb2-2146f672cf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0f6f0d-14be-4769-bbb2-2146f672cf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ddd127-d8dd-4472-a346-6335da83d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Volume 54a26fa3-2d77-49d0-9a34-70bf07d4085b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b', 'volume_size': 1} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-11299330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a26fa3-2d77-49d0-9a34-70bf07d4085b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:19Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Creating volume 54a26fa3-2d77-49d0-9a34-70bf07d4085b {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:00:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:18 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b 1073741824 Sep 01 02:00:18 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:19 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b 1073741824" returned: 0 in 0.570s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:19 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b Sep 01 02:00:19 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:19 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ddd127-d8dd-4472-a346-6335da83d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50de95fd-eaaa-4588-b49c-4017dad0265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Volume volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b (54a26fa3-2d77-49d0-9a34-70bf07d4085b): created successfully Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50de95fd-eaaa-4588-b49c-4017dad0265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (87002513-52c0-4445-8f76-3d834e8e98b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-56f7c4a0-07db-4aeb-ac69-ea7c4b9ede88 tempest-VolumesTestJSON-90242645 None] Created volume successfully. Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (e177bbaa-a716-48c3-8388-b06734afeb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b8f073-5ff8-4000-9af7-3966fc9cc370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b8f073-5ff8-4000-9af7-3966fc9cc370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1652335730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885ab5ce-4185-4836-833e-b9f4d3b5feaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:22Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c98207a-2bae-460d-b7cd-0ab56960e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c98207a-2bae-460d-b7cd-0ab56960e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5c19d-f03e-4844-85db-074f7ca711ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5c19d-f03e-4844-85db-074f7ca711ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885ab5ce-4185-4836-833e-b9f4d3b5feaa', 'volume_name': 'volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d15606-89b8-4542-ae5f-d70ed054ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d15606-89b8-4542-ae5f-d70ed054ef69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c68f83-2cdc-48f0-a7d7-65daff4a583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Volume 885ab5ce-4185-4836-833e-b9f4d3b5feaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa', 'volume_size': 1} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1652335730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885ab5ce-4185-4836-833e-b9f4d3b5feaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='342bd6ff5f3248b3a6de98342968ff52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:22Z,use_quota=True,user_id='b041087fb873400c9c27c5556fcaf45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Creating volume 885ab5ce-4185-4836-833e-b9f4d3b5feaa {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:21 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:00:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:21 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa 1073741824 Sep 01 02:00:21 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:22 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa 1073741824" returned: 0 in 0.547s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:22 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa Sep 01 02:00:22 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:22 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa" returned: 0 in 0.301s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c68f83-2cdc-48f0-a7d7-65daff4a583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d64b208-1627-4a56-ae25-8d2d2e2806d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:22 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Volume volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa (885ab5ce-4185-4836-833e-b9f4d3b5feaa): created successfully Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d64b208-1627-4a56-ae25-8d2d2e2806d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Flow 'volume_create_manager' (e177bbaa-a716-48c3-8388-b06734afeb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d81b67f3-a9fc-4396-9882-a2b05221af0c tempest-VolumesTestJSON-90242645 None] Created volume successfully. Sep 01 02:00:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-885ab5ce-4185-4836-833e-b9f4d3b5feaa-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "cinder-885ab5ce-4185-4836-833e-b9f4d3b5feaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-quobyte-885ab5ce-4185-4836-833e-b9f4d3b5feaa" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-885ab5ce-4185-4836-833e-b9f4d3b5feaa" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:24 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdgnvj_c6/privsep.sock'] Sep 01 02:00:24 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdgnvj_c6/privsep.sock Sep 01 02:00:24 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:00:26 devstack cinder-volume[86925]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 02:00:26 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:26 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Spawned new privsep daemon via rootwrap Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Accepted privsep connection to /tmp/tmpdgnvj_c6/privsep.sock {{(pid=86925) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 02:00:26 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 02:00:26 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 02:00:26 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 02:00:26 devstack cinder-volume[86925]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87892 Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee6ffbc-ce6d-4dbe-b443-0beaeb4c24b0]: (2,) {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[391fdbc8-bfcd-45d0-825c-786504b2a71e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:26 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa Sep 01 02:00:26 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:26 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa" returned: 0 in 0.429s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:26 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa Sep 01 02:00:26 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:26 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-885ab5ce-4185-4836-833e-b9f4d3b5feaa" returned: 0 in 0.288s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-885ab5ce-4185-4836-833e-b9f4d3b5feaa" released by "delete_volume" :: held 2.081s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:27 devstack cinder-volume[86925]: WARNING cinder.quota [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:27 devstack cinder-volume[86925]: WARNING cinder.quota [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Created reservations ['592918b8-5eb8-4cc4-890f-ee1ae81b8317', '8717d9ec-2bb9-4e5f-8aff-c753f06750f4', 'e1ee0e51-6adb-4ae3-9486-2c99e086b2a3', '20bdc7ea-c5a2-4c0f-9644-aaf06e09b8b0'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:27 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:00:27 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:27 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Deleted volume successfully. Sep 01 02:00:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a84c6015-8ad2-4665-8beb-0f44e417eb84 tempest-VolumesTestJSON-90242645 None] Lock "cinder-885ab5ce-4185-4836-833e-b9f4d3b5feaa-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-54a26fa3-2d77-49d0-9a34-70bf07d4085b-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "cinder-54a26fa3-2d77-49d0-9a34-70bf07d4085b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-quobyte-54a26fa3-2d77-49d0-9a34-70bf07d4085b" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-54a26fa3-2d77-49d0-9a34-70bf07d4085b" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355a45e-df84-4890-b0dd-1ad6659e7d51]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b Sep 01 02:00:28 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b" returned: 0 in 0.455s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b Sep 01 02:00:28 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:29 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54a26fa3-2d77-49d0-9a34-70bf07d4085b" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-54a26fa3-2d77-49d0-9a34-70bf07d4085b" released by "delete_volume" :: held 0.783s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Created reservations ['a81f0773-567c-435c-b329-e68016b5ac75', '7b6c8db9-7ee1-4958-b882-5baaf8403c13', 'fa04a7ff-253e-465e-a57d-bf0e3e0cd43b', '2e388bf9-3359-41e8-a774-20a0e1e984c0'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:29 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:00:29 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-73a35b38-c48a-47f2-8680-07dbfcfc6ffc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "cinder-73a35b38-c48a-47f2-8680-07dbfcfc6ffc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:29 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Deleted volume successfully. Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Acquiring lock "cinder-quobyte-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081bd24-eea5-4d50-838d-63b6dad00006]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8101bb3c-c59c-450d-aa05-f066eb3ef8e2 tempest-VolumesTestJSON-90242645 None] Lock "cinder-54a26fa3-2d77-49d0-9a34-70bf07d4085b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:29 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc Sep 01 02:00:29 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:30 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" returned: 0 in 0.436s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:30 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc Sep 01 02:00:30 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:30 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" returned: 0 in 0.400s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "cinder-quobyte-73a35b38-c48a-47f2-8680-07dbfcfc6ffc" released by "delete_volume" :: held 0.912s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Created reservations ['22568e03-a31a-485b-be27-6f4a8d26ed7c', 'e3de89aa-9613-4b28-8938-b3c9cd6c5a73', '16eacbf6-0bc4-4d50-ab78-74b9e78fca66', '693631fd-c5cf-483b-a431-50ed53d322bf'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:30 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:00:30 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:31 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.319s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Deleted volume successfully. Sep 01 02:00:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c6277266-d426-49dd-b569-bd2dd842b10b tempest-VolumesTestJSON-90242645 None] Lock "cinder-73a35b38-c48a-47f2-8680-07dbfcfc6ffc-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-351d98ef-984c-4174-aa96-7b7ac8da789b tempest-GroupSnapshotsV319Test-411857117 None] Group tempest-GroupSnapshotsV319Test-Group-515195957: creating Sep 01 02:00:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-351d98ef-984c-4174-aa96-7b7ac8da789b tempest-GroupSnapshotsV319Test-411857117 None] Group tempest-GroupSnapshotsV319Test-Group-515195957: created successfully Sep 01 02:00:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-351d98ef-984c-4174-aa96-7b7ac8da789b tempest-GroupSnapshotsV319Test-411857117 None] Create group completed successfully. Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Flow 'volume_create_manager' (7f6d2d27-662b-4b8f-85ad-06c4aad99b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6701432f-0b01-420c-bd69-3481b95350a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6701432f-0b01-420c-bd69-3481b95350a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890075734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05c7dc33-61e0-40c6-b20a-58b8b5e4ef92,host='devstack@QuobyteHD#QuobyteHD',id=85d0fc28-95af-4509-94d2-d6e8f00a2ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c15ffacf7f4544807f0dd991f95a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:40Z,use_quota=True,user_id='7bfdc99912b24d4a94ce1d050ad1e738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a18d6fca-221c-4aaa-8903-cea354f5eb43),volume_type_id=a18d6fca-221c-4aaa-8903-cea354f5eb43)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d829e2-b746-4966-8b78-5ce08b406085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d829e2-b746-4966-8b78-5ce08b406085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef871c47-1e34-4efb-bf02-b3f3e567fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef871c47-1e34-4efb-bf02-b3f3e567fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d0fc28-95af-4509-94d2-d6e8f00a2ce4', 'volume_name': 'volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4166eb-136c-4691-8bdb-6445df237501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4166eb-136c-4691-8bdb-6445df237501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663d5c6c-b8ff-4922-8975-d37f2f4e858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Volume 85d0fc28-95af-4509-94d2-d6e8f00a2ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4', 'volume_size': 1} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05c7dc33-61e0-40c6-b20a-58b8b5e4ef92,created_at=2026-09-01T00:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890075734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05c7dc33-61e0-40c6-b20a-58b8b5e4ef92,host='devstack@QuobyteHD#QuobyteHD',id=85d0fc28-95af-4509-94d2-d6e8f00a2ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c15ffacf7f4544807f0dd991f95a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:40Z,use_quota=True,user_id='7bfdc99912b24d4a94ce1d050ad1e738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a18d6fca-221c-4aaa-8903-cea354f5eb43),volume_type_id=a18d6fca-221c-4aaa-8903-cea354f5eb43)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Creating volume 85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:40 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:40 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 1073741824 Sep 01 02:00:40 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:40 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:00:40 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:40 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 1073741824" returned: 0 in 0.613s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:41 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 Sep 01 02:00:41 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:41 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.423s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:41 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" returned: 0 in 0.424s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663d5c6c-b8ff-4922-8975-d37f2f4e858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3947a84-b841-4127-9562-e2bbb54b60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Volume volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 (85d0fc28-95af-4509-94d2-d6e8f00a2ce4): created successfully Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3947a84-b841-4127-9562-e2bbb54b60c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Flow 'volume_create_manager' (7f6d2d27-662b-4b8f-85ad-06c4aad99b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-69995329-5e2a-44eb-b68b-1ffb8ee108f0 tempest-GroupSnapshotsV319Test-411857117 None] Created volume successfully. Sep 01 02:00:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] GroupSnapshot a9832b2e-fb70-4383-b893-a5f0887529cd: creating. Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Group snapshot a9832b2e-fb70-4383-b893-a5f0887529cd: creating. {{(pid=86925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Creating offline snapshot 3ef42334-93a0-47e3-902f-d1d8c0763f15 of volume 85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80061e1-be24-4d02-a15a-27e1ba121eba]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:43 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 Sep 01 02:00:43 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" returned: 0 in 0.619s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 1G Sep 01 02:00:44 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 1G" returned: 0 in 0.660s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 Sep 01 02:00:44 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:45 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15" returned: 0 in 0.398s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:45 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:45 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 Sep 01 02:00:45 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:45 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15" returned: 0 in 0.296s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:45 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info Sep 01 02:00:45 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:45 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info" returned: 0 in 0.336s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:45 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:45 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info Sep 01 02:00:45 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:46 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.info" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dd687bdf-ca94-4135-9e2d-87f655d545c4 tempest-GroupSnapshotsV319Test-411857117 None] group_snapshot a9832b2e-fb70-4383-b893-a5f0887529cd: created successfully Sep 01 02:00:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] group_snapshot a9832b2e-fb70-4383-b893-a5f0887529cd: deleting Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] group_snapshot a9832b2e-fb70-4383-b893-a5f0887529cd: deleting {{(pid=86925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "cinder-quobyte-3ef42334-93a0-47e3-902f-d1d8c0763f15" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-3ef42334-93a0-47e3-902f-d1d8c0763f15" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Deleting offline snapshot 3ef42334-93a0-47e3-902f-d1d8c0763f15 of volume 85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] snapshot_file for this snap is: volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ada74c-6bd2-480b-b05e-1ad3e4681887]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:48 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 Sep 01 02:00:48 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15" returned: 0 in 0.534s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c36a0-2797-4027-b79a-7469a08d692c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:48 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 Sep 01 02:00:48 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" returned: 0 in 0.496s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:48 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 Sep 01 02:00:48 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:49 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15" returned: 0 in 0.446s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:49 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15 Sep 01 02:00:49 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:49 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4.3ef42334-93a0-47e3-902f-d1d8c0763f15" returned: 0 in 0.339s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-3ef42334-93a0-47e3-902f-d1d8c0763f15" released by "_delete_snapshot" :: held 1.956s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" released by "delete_snapshot" :: held 1.989s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:49 devstack cinder-volume[86925]: WARNING cinder.quota [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1787385302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1787385302, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:49 devstack cinder-volume[86925]: WARNING cinder.quota [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1787385302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1787385302, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:49 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] Created reservations ['77eadac1-e93c-404a-bb89-8061fdfdfece', '84252a50-5fce-4683-b674-70760c6cb52a', '647f866d-6c02-4781-b7b5-efb7b2b55031', 'eb915217-0b9e-4072-8349-188c5464e5a9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9d0923a4-8602-4585-84ca-ce4a5789ab83 tempest-GroupSnapshotsV319Test-411857117 None] group_snapshot a9832b2e-fb70-4383-b893-a5f0887529cd: deleted successfully Sep 01 02:00:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:50 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2ce303-6a36-4c94-9103-c6b362e5b8e1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:50 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 Sep 01 02:00:50 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:51 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" returned: 0 in 0.471s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:51 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4 Sep 01 02:00:51 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:51 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" returned: 0 in 0.382s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Lock "cinder-quobyte-85d0fc28-95af-4509-94d2-d6e8f00a2ce4" released by "delete_volume" :: held 0.968s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Created reservations ['57c1966c-2881-48f1-bf60-454efd5ffe9a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:51 devstack cinder-volume[86925]: WARNING cinder.quota [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1787385302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1787385302, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:51 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Created reservations ['3a69074c-87bc-4958-b77b-24e23c9955c9', '73a1e4b3-87ad-4ed3-826e-42647fd89bd1', '9b976952-af39-4fc5-a778-45fe1dd3f023', 'c271080b-e9ad-490a-97fc-a9d83cc0a4ee'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:52 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:00:52 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:52 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.311s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:52 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-de6cf548-528a-41ab-b2fc-b576e0149cde tempest-GroupSnapshotsV319Test-411857117 None] Delete group completed successfully. Sep 01 02:01:01 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=43,cinder:UPDATE=55,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:02 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=49,cinder:INSERT=11,cinder:UPDATE=58,cinder:DELETE=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Flow 'volume_create_manager' (ff0eb5e9-4c88-4de9-ae55-5057b685edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e6cd0b-54e4-4b6a-972e-f0ea6d4cb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e6cd0b-54e4-4b6a-972e-f0ea6d4cb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-17375918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58af8849-6332-4e0a-90ea-c8080230264c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57926f494a11486e9daf19154a764d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:17Z,use_quota=True,user_id='cacd3190fec84ca7b7c7424b7d8978c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6666121-271d-4f2c-b218-03389af60ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6666121-271d-4f2c-b218-03389af60ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e45f78-c28c-4d0c-abb6-7338291bc4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e45f78-c28c-4d0c-abb6-7338291bc4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58af8849-6332-4e0a-90ea-c8080230264c', 'volume_name': 'volume-58af8849-6332-4e0a-90ea-c8080230264c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749cbf3-dc16-4c58-9ced-8007cc27c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749cbf3-dc16-4c58-9ced-8007cc27c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8e104b-2606-4cfa-8ccd-25832592b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Volume 58af8849-6332-4e0a-90ea-c8080230264c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58af8849-6332-4e0a-90ea-c8080230264c', 'volume_size': 1} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-17375918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58af8849-6332-4e0a-90ea-c8080230264c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57926f494a11486e9daf19154a764d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:17Z,use_quota=True,user_id='cacd3190fec84ca7b7c7424b7d8978c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Creating volume 58af8849-6332-4e0a-90ea-c8080230264c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:17 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:01:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:17 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c 1073741824 Sep 01 02:01:17 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:18 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c 1073741824" returned: 0 in 0.914s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:18 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c Sep 01 02:01:18 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:18 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8e104b-2606-4cfa-8ccd-25832592b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58af8849-6332-4e0a-90ea-c8080230264c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409ab0c5-c899-4be2-9513-00fba7536608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Volume volume-58af8849-6332-4e0a-90ea-c8080230264c (58af8849-6332-4e0a-90ea-c8080230264c): created successfully Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409ab0c5-c899-4be2-9513-00fba7536608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Flow 'volume_create_manager' (ff0eb5e9-4c88-4de9-ae55-5057b685edbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4a9a692c-aa44-41e9-ac2c-c22263dc0a52 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Created volume successfully. Sep 01 02:01:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Acquiring lock "cinder-58af8849-6332-4e0a-90ea-c8080230264c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "cinder-58af8849-6332-4e0a-90ea-c8080230264c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Acquiring lock "cinder-quobyte-58af8849-6332-4e0a-90ea-c8080230264c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "cinder-quobyte-58af8849-6332-4e0a-90ea-c8080230264c" acquired by "delete_volume" :: waited 0.076s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27cd916-15fb-4999-bdbf-e10208ac11fb]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:24 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c Sep 01 02:01:24 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:25 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c" returned: 0 in 0.919s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c Sep 01 02:01:25 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:25 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-58af8849-6332-4e0a-90ea-c8080230264c" returned: 0 in 0.550s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "cinder-quobyte-58af8849-6332-4e0a-90ea-c8080230264c" released by "delete_volume" :: held 1.598s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Created reservations ['a80adfb5-80bd-44d8-823f-069661f7b22d', 'ffba89b4-3934-47f5-a049-0eb1417049de', '7648d4a6-8bcf-48fd-81de-f2f741201b4e', '409e714d-f2e1-4c94-82de-69c451e3e39c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:25 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:26 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.579s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Deleted volume successfully. Sep 01 02:01:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fe1ee918-47a7-49c1-bb75-4dd9e898b101 tempest-VolumeQuotasNegativeTestJSON-62485533 None] Lock "cinder-58af8849-6332-4e0a-90ea-c8080230264c-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Flow 'volume_create_manager' (19068444-47cc-4914-ad63-d7fdf5de318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5fc604-c2bd-4131-83cb-b8bfb2e21998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5fc604-c2bd-4131-83cb-b8bfb2e21998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-610417195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2077db-b464-430d-a94b-6320c3a2e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b17e75b97694811aa78137dd9605dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:29Z,use_quota=True,user_id='ef43b5e7eaf946809a749c4504f8f088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156facfb-a469-4e5f-9814-4816b0a9278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156facfb-a469-4e5f-9814-4816b0a9278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193914f4-416a-4847-9112-ccfd82f2877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193914f4-416a-4847-9112-ccfd82f2877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2077db-b464-430d-a94b-6320c3a2e903', 'volume_name': 'volume-6a2077db-b464-430d-a94b-6320c3a2e903', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb915e2-b7d4-4435-9fb7-3d2bacfe7748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb915e2-b7d4-4435-9fb7-3d2bacfe7748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c592f15-983e-4c03-a9a2-fd30d76f8b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Volume 6a2077db-b464-430d-a94b-6320c3a2e903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2077db-b464-430d-a94b-6320c3a2e903', 'volume_size': 1} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-610417195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2077db-b464-430d-a94b-6320c3a2e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b17e75b97694811aa78137dd9605dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:29Z,use_quota=True,user_id='ef43b5e7eaf946809a749c4504f8f088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Creating volume 6a2077db-b464-430d-a94b-6320c3a2e903 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:28 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:01:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 1073741824 Sep 01 02:01:28 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 1073741824" returned: 0 in 1.079s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:30 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 Sep 01 02:01:30 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:30 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903" returned: 0 in 0.780s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c592f15-983e-4c03-a9a2-fd30d76f8b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2077db-b464-430d-a94b-6320c3a2e903', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b283f45-7b4f-4d51-9904-cb7745bd6a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Volume volume-6a2077db-b464-430d-a94b-6320c3a2e903 (6a2077db-b464-430d-a94b-6320c3a2e903): created successfully Sep 01 02:01:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b283f45-7b4f-4d51-9904-cb7745bd6a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Flow 'volume_create_manager' (19068444-47cc-4914-ad63-d7fdf5de318a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0d678e03-9a93-488f-a980-1280107ae1f8 tempest-VolumesAdminNegativeTest-1648258584 None] Created volume successfully. Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Acquiring lock "cinder-6a2077db-b464-430d-a94b-6320c3a2e903-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "cinder-6a2077db-b464-430d-a94b-6320c3a2e903-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Acquiring lock "cinder-quobyte-6a2077db-b464-430d-a94b-6320c3a2e903" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "cinder-quobyte-6a2077db-b464-430d-a94b-6320c3a2e903" acquired by "delete_volume" :: waited 0.049s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[25029d26-cf22-4d93-876a-43abc5b533c5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:33 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 Sep 01 02:01:33 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:34 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903" returned: 0 in 0.884s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:34 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903 Sep 01 02:01:34 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:34 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a2077db-b464-430d-a94b-6320c3a2e903" returned: 0 in 0.486s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "cinder-quobyte-6a2077db-b464-430d-a94b-6320c3a2e903" released by "delete_volume" :: held 1.505s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Created reservations ['8b4380a9-ccf3-4206-9b00-14bd61177e4a', '57f95ede-5ad3-41e7-a3ff-5550cf71adc9', '1c6f55a7-8afb-4b94-bb53-da6e907bba38', '20e30f58-e023-424d-a48e-a9bb59800422'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:35 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:35 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:35 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.545s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Deleted volume successfully. Sep 01 02:01:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7be15e0d-9e1a-459c-aa4b-e7485e06b74d tempest-VolumesAdminNegativeTest-1648258584 None] Lock "cinder-6a2077db-b464-430d-a94b-6320c3a2e903-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Flow 'volume_create_manager' (da60b3e7-b3cb-4694-88c5-2fd2553095b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabfa0e0-0871-40e5-9974-5f0fcdf0201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabfa0e0-0871-40e5-9974-5f0fcdf0201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1637577893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7908a053-a6d0-4d0e-a35c-8d5a6cf0f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e54de50a676493797c8f44eec221abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:40Z,use_quota=True,user_id='6c1fa9047aa042d890353438b871ed9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c8fb821-1def-4c59-9a53-e53e34be54a1),volume_type_id=2c8fb821-1def-4c59-9a53-e53e34be54a1)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba04db9-4bbd-47d8-b5a0-bf59e9182e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba04db9-4bbd-47d8-b5a0-bf59e9182e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7501249-3417-47c5-a53e-d79141c66e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7501249-3417-47c5-a53e-d79141c66e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7908a053-a6d0-4d0e-a35c-8d5a6cf0f160', 'volume_name': 'volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d478e4-de76-4246-8161-2c86e342b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d478e4-de76-4246-8161-2c86e342b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533ae706-d64b-4466-9524-2955a97c2e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Volume 7908a053-a6d0-4d0e-a35c-8d5a6cf0f160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160', 'volume_size': 1} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1637577893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7908a053-a6d0-4d0e-a35c-8d5a6cf0f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e54de50a676493797c8f44eec221abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:40Z,use_quota=True,user_id='6c1fa9047aa042d890353438b871ed9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c8fb821-1def-4c59-9a53-e53e34be54a1),volume_type_id=2c8fb821-1def-4c59-9a53-e53e34be54a1)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Creating volume 7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:40 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:40 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 1073741824 Sep 01 02:01:40 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:40 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 1073741824" returned: 0 in 0.620s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:40 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:40 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:40 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 Sep 01 02:01:40 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:40 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Flow 'volume_create_manager' (619c56d3-d899-4068-a69c-e89f3045da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacdc19f-87d0-44cf-810e-7713087a8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacdc19f-87d0-44cf-810e-7713087a8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-878064406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489ffaa6-4ac2-4266-9565-5f44138cdb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7c99310af4ff1aff5ab8cd253260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:41Z,use_quota=True,user_id='e41023777cfd4ca796687bf51a134417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc49a380-6a31-4f04-8a35-1384637a8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc49a380-6a31-4f04-8a35-1384637a8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548561b-f796-447c-98f9-2bd8dc54629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548561b-f796-447c-98f9-2bd8dc54629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489ffaa6-4ac2-4266-9565-5f44138cdb95', 'volume_name': 'volume-489ffaa6-4ac2-4266-9565-5f44138cdb95', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3f921-1ca7-4d70-80ec-7c8536802bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3f921-1ca7-4d70-80ec-7c8536802bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59f9430-a40d-48a6-896e-74af6c841ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Volume 489ffaa6-4ac2-4266-9565-5f44138cdb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489ffaa6-4ac2-4266-9565-5f44138cdb95', 'volume_size': 1} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:41 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" returned: 0 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-878064406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489ffaa6-4ac2-4266-9565-5f44138cdb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7c99310af4ff1aff5ab8cd253260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:41Z,use_quota=True,user_id='e41023777cfd4ca796687bf51a134417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Creating volume 489ffaa6-4ac2-4266-9565-5f44138cdb95 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:41 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533ae706-d64b-4466-9524-2955a97c2e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 1073741824 Sep 01 02:01:41 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e2121-bf85-4e99-9802-7030ce0cfc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Volume volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 (7908a053-a6d0-4d0e-a35c-8d5a6cf0f160): created successfully Sep 01 02:01:41 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e2121-bf85-4e99-9802-7030ce0cfc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Flow 'volume_create_manager' (da60b3e7-b3cb-4694-88c5-2fd2553095b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.601s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 8 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:01:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4629707d-b031-4dc8-a959-9bf1209a524f tempest-VolumeTypesAccessTest-1941101851 None] Created volume successfully. Sep 01 02:01:41 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 1073741824" returned: 0 in 0.547s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:41 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 Sep 01 02:01:41 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:42 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95" returned: 0 in 0.314s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59f9430-a40d-48a6-896e-74af6c841ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489ffaa6-4ac2-4266-9565-5f44138cdb95', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7a5ffd-76de-46bd-a06d-f758ad75b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:42 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Volume volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 (489ffaa6-4ac2-4266-9565-5f44138cdb95): created successfully Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7a5ffd-76de-46bd-a06d-f758ad75b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Flow 'volume_create_manager' (619c56d3-d899-4068-a69c-e89f3045da67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4644cb0e-5000-4723-9c27-c8d92062aea8 tempest-ServersNegativeTestJSON-278533766 None] Created volume successfully. Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Acquiring lock "cinder-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "cinder-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Acquiring lock "cinder-quobyte-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "cinder-quobyte-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a0526-8c3c-4e81-ba75-f0c8a5ed1d8c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:42 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 Sep 01 02:01:42 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:42 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" returned: 0 in 0.553s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:43 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160 Sep 01 02:01:43 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:43 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "cinder-quobyte-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160" released by "delete_volume" :: held 0.980s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:43 devstack cinder-volume[86925]: WARNING cinder.quota [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1731516366 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1731516366, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:43 devstack cinder-volume[86925]: WARNING cinder.quota [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1731516366 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1731516366, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Created reservations ['61073655-0b5b-4484-974f-df1a0db53564', '64c3d4d1-3297-418e-94a9-e4086622a020', '909bbdbc-085f-4dea-8eb1-10f2ce4e47a3', '0995a6dd-f22f-4e5b-81f9-603b52e10b1d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:43 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:43 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:43 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.274s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Deleted volume successfully. Sep 01 02:01:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ce874e3-015b-43a0-a51b-b4aa9ede051a tempest-VolumeTypesAccessTest-1941101851 None] Lock "cinder-7908a053-a6d0-4d0e-a35c-8d5a6cf0f160-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Flow 'volume_create_manager' (375101e0-6e8e-440c-ab36-baf1a4a4d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a24dda-7815-4f55-8825-faf3bd410241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a24dda-7815-4f55-8825-faf3bd410241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1922311454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12782c-2c81-4e5b-8177-ed76e87baa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7c99310af4ff1aff5ab8cd253260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:45Z,use_quota=True,user_id='e41023777cfd4ca796687bf51a134417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b55546-dbae-4ef9-8327-bfb4793a317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b55546-dbae-4ef9-8327-bfb4793a317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18430641-3c04-4e54-a7f6-6abc1987e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18430641-3c04-4e54-a7f6-6abc1987e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed12782c-2c81-4e5b-8177-ed76e87baa91', 'volume_name': 'volume-ed12782c-2c81-4e5b-8177-ed76e87baa91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6424e230-e13c-4ae1-9cdf-60bc80656f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6424e230-e13c-4ae1-9cdf-60bc80656f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b0dfc6-bd4b-4173-8ee0-9667783d3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Volume ed12782c-2c81-4e5b-8177-ed76e87baa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed12782c-2c81-4e5b-8177-ed76e87baa91', 'volume_size': 1} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1922311454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12782c-2c81-4e5b-8177-ed76e87baa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de7c99310af4ff1aff5ab8cd253260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:45Z,use_quota=True,user_id='e41023777cfd4ca796687bf51a134417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Creating volume ed12782c-2c81-4e5b-8177-ed76e87baa91 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:44 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:01:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:44 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 1073741824 Sep 01 02:01:44 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:45 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 1073741824" returned: 0 in 0.578s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:45 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 Sep 01 02:01:45 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:45 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91" returned: 0 in 0.397s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b0dfc6-bd4b-4173-8ee0-9667783d3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed12782c-2c81-4e5b-8177-ed76e87baa91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e30d1a-2c0d-47a8-b48d-f3a134a5660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:45 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Volume volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 (ed12782c-2c81-4e5b-8177-ed76e87baa91): created successfully Sep 01 02:01:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e30d1a-2c0d-47a8-b48d-f3a134a5660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Flow 'volume_create_manager' (375101e0-6e8e-440c-ab36-baf1a4a4d08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3dd6ea8a-2f33-4c0d-9b03-c8d4a1ad648c tempest-ServersNegativeTestJSON-278533766 None] Created volume successfully. Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "cinder-ed12782c-2c81-4e5b-8177-ed76e87baa91-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-ed12782c-2c81-4e5b-8177-ed76e87baa91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "cinder-quobyte-ed12782c-2c81-4e5b-8177-ed76e87baa91" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-quobyte-ed12782c-2c81-4e5b-8177-ed76e87baa91" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be3efdb-184c-4adf-989b-4f23861e25a3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:48 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 Sep 01 02:01:48 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:48 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:48 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91 Sep 01 02:01:48 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:48 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed12782c-2c81-4e5b-8177-ed76e87baa91" returned: 0 in 0.303s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-quobyte-ed12782c-2c81-4e5b-8177-ed76e87baa91" released by "delete_volume" :: held 0.756s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:48 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Created reservations ['5242b285-eb1b-4e02-af85-805f48635d20', 'f74aba81-504e-43b4-b42a-1edf55db234d', '44eeab8d-3ca3-4c1a-83ac-740cd12cee8c', 'c6939994-1e7d-4804-9377-01b3ca5f2757'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:49 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:49 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "cinder-489ffaa6-4ac2-4266-9565-5f44138cdb95-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-489ffaa6-4ac2-4266-9565-5f44138cdb95-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:49 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Deleted volume successfully. Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "cinder-quobyte-489ffaa6-4ac2-4266-9565-5f44138cdb95" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-quobyte-489ffaa6-4ac2-4266-9565-5f44138cdb95" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9e1133b9-ba5e-4a60-a594-748ecf44a37a tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-ed12782c-2c81-4e5b-8177-ed76e87baa91-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae00762-009b-48ff-a716-36e974f15114]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:49 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 Sep 01 02:01:49 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:49 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95" returned: 0 in 0.400s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:49 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95 Sep 01 02:01:49 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:50 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-489ffaa6-4ac2-4266-9565-5f44138cdb95" returned: 0 in 0.281s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-quobyte-489ffaa6-4ac2-4266-9565-5f44138cdb95" released by "delete_volume" :: held 0.743s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Created reservations ['00fe57d8-4a8e-4263-b34f-4f10eb9302dd', '65c3a85f-3799-40ab-9dcc-32b1cd72e2f9', 'a30c7bb3-4957-47a9-bb37-b2537d2de50d', '21ae04e8-5726-4d3b-bddb-c38f3197e6eb'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:50 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:01:50 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:50 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Deleted volume successfully. Sep 01 02:01:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-80a61c79-eb67-4064-a48b-23bd027e7538 tempest-ServersNegativeTestJSON-278533766 None] Lock "cinder-489ffaa6-4ac2-4266-9565-5f44138cdb95-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=62,cinder:SELECT=30,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=40,cinder:UPDATE=48,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Flow 'volume_create_manager' (a60b300b-56f2-407c-a1a2-df02a1e13c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc950320-49ee-469e-a1fb-25ce6e77ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc950320-49ee-469e-a1fb-25ce6e77ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-916600853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7040ec8f-84db-44a7-accc-1a6e7fbf7ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1db19beb124dd488a26b8d7461aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:01Z,use_quota=True,user_id='88f472c79d184e3d9b7e0e9b1a6da930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7380e36-0719-4e58-9070-22e627806dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7380e36-0719-4e58-9070-22e627806dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33107ad-bb18-46e3-b454-691eabaf47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33107ad-bb18-46e3-b454-691eabaf47ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7040ec8f-84db-44a7-accc-1a6e7fbf7ed2', 'volume_name': 'volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e818e4-5249-4d76-9521-cab6e211e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e818e4-5249-4d76-9521-cab6e211e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5650d0f-b509-49ee-a3fd-f8b42c0d8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:00 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Volume 7040ec8f-84db-44a7-accc-1a6e7fbf7ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2', 'volume_size': 1} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-916600853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7040ec8f-84db-44a7-accc-1a6e7fbf7ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1db19beb124dd488a26b8d7461aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:01Z,use_quota=True,user_id='88f472c79d184e3d9b7e0e9b1a6da930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Creating volume 7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:00 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:02:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:00 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 1073741824 Sep 01 02:02:00 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:01 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 1073741824" returned: 0 in 0.587s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:01 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 Sep 01 02:02:01 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:01 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" returned: 0 in 0.422s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5650d0f-b509-49ee-a3fd-f8b42c0d8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153cacd-ed15-4ae4-bcbf-55af0c2bffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:02 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Volume volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 (7040ec8f-84db-44a7-accc-1a6e7fbf7ed2): created successfully Sep 01 02:02:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153cacd-ed15-4ae4-bcbf-55af0c2bffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Flow 'volume_create_manager' (a60b300b-56f2-407c-a1a2-df02a1e13c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eed953b5-00ce-46b6-b05f-3e7f13ca08b6 tempest-SnapshotMetadataTestJSON-813281719 None] Created volume successfully. Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Creating offline snapshot aa0cf455-a647-4d95-a63b-90af718e0b15 of volume 7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce932f9-2d0d-4874-9712-ba5d97d54f4b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:03 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 Sep 01 02:02:03 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:03 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" returned: 0 in 0.503s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:03 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 1G Sep 01 02:02:03 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 1G" returned: 0 in 0.532s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 Sep 01 02:02:04 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15" returned: 0 in 0.379s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 is being set with open permissions: ugo+rw Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 Sep 01 02:02:04 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info Sep 01 02:02:05 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:05 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info" returned: 0 in 0.450s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:05 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info is being set with open permissions: ugo+rw Sep 01 02:02:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:05 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info Sep 01 02:02:05 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:05 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.info" returned: 0 in 0.426s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f14c7a5f-4ebd-4f02-b3c2-5681c9758252 tempest-SnapshotMetadataTestJSON-813281719 None] Create snapshot completed successfully Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "cinder-aa0cf455-a647-4d95-a63b-90af718e0b15-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-aa0cf455-a647-4d95-a63b-90af718e0b15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "cinder-quobyte-aa0cf455-a647-4d95-a63b-90af718e0b15" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-aa0cf455-a647-4d95-a63b-90af718e0b15" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Deleting offline snapshot aa0cf455-a647-4d95-a63b-90af718e0b15 of volume 7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] snapshot_file for this snap is: volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5969788-7bb7-4bf9-8f42-4c599a32cf1a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:07 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 Sep 01 02:02:07 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:08 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15" returned: 0 in 0.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991d2ee-5b30-4357-83ad-12f8db26443d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:08 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 Sep 01 02:02:08 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:08 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" returned: 0 in 0.486s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:08 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 Sep 01 02:02:08 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:09 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:09 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15 Sep 01 02:02:09 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:09 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2.aa0cf455-a647-4d95-a63b-90af718e0b15" returned: 0 in 0.309s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-aa0cf455-a647-4d95-a63b-90af718e0b15" released by "_delete_snapshot" :: held 1.869s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" released by "delete_snapshot" :: held 1.902s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:09 devstack cinder-volume[86925]: WARNING cinder.quota [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Created reservations ['ca713cc5-89f6-41ef-85ab-95341a016b3b', '0e58fcec-d4ee-4b42-96ff-34a1dad695e9', '63566d38-aae9-40a3-80b2-2cf27eb97bb7', 'a0ba9584-f26f-44a8-b532-ba1e1cc92564'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Delete snapshot completed successfully. Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdecb704-13cb-489c-b4f6-f9a46e3d65ba tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-aa0cf455-a647-4d95-a63b-90af718e0b15-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "cinder-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086a869-9221-490a-8c9c-2b2159b0c115]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:10 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 Sep 01 02:02:10 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:10 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" returned: 0 in 0.460s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:10 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2 Sep 01 02:02:10 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:10 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-quobyte-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2" released by "delete_volume" :: held 0.782s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Created reservations ['705648dc-f215-4e8c-b29a-6f2ae05a977f', 'ec9f932e-7597-4dfd-9160-85e6aa661a3a', '1dd20df2-69ba-436f-92b5-f9bada113fc4', '92f77d25-8a38-45ff-bd11-988cb2205345'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:10 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:02:10 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:11 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.372s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:11 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Deleted volume successfully. Sep 01 02:02:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f5bdb2b-0470-475a-9ac7-22ca128b94e0 tempest-SnapshotMetadataTestJSON-813281719 None] Lock "cinder-7040ec8f-84db-44a7-accc-1a6e7fbf7ed2-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:20 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:21 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Flow 'volume_create_manager' (2636af4d-cdb0-4260-b45b-e56592a07266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc8ca42-e257-4995-9835-b17107ff71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc8ca42-e257-4995-9835-b17107ff71c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1813751387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419798f4-8d34-469b-8a67-4f7a87d14cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291214e388c04f289e6f70575f9861d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:27Z,use_quota=True,user_id='bf9a9e4a283c4d9a9be20973abf74d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d52084-ea9e-4df4-913a-858362869ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d52084-ea9e-4df4-913a-858362869ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8765c1-6f89-4543-baaa-25394ab2fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8765c1-6f89-4543-baaa-25394ab2fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419798f4-8d34-469b-8a67-4f7a87d14cb0', 'volume_name': 'volume-419798f4-8d34-469b-8a67-4f7a87d14cb0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d114d154-333a-45f0-aa95-f0fe7939ad5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d114d154-333a-45f0-aa95-f0fe7939ad5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61310087-cdae-4d37-9f6a-45170535b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Volume 419798f4-8d34-469b-8a67-4f7a87d14cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419798f4-8d34-469b-8a67-4f7a87d14cb0', 'volume_size': 1} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1813751387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419798f4-8d34-469b-8a67-4f7a87d14cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291214e388c04f289e6f70575f9861d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:27Z,use_quota=True,user_id='bf9a9e4a283c4d9a9be20973abf74d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Creating volume 419798f4-8d34-469b-8a67-4f7a87d14cb0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:27 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:27 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 1073741824 Sep 01 02:02:27 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:27 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 1073741824" returned: 0 in 0.741s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:27 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 Sep 01 02:02:27 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:28 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0" returned: 0 in 0.333s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61310087-cdae-4d37-9f6a-45170535b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419798f4-8d34-469b-8a67-4f7a87d14cb0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89960efb-2855-4a34-ae5e-4252cb3c74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Volume volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 (419798f4-8d34-469b-8a67-4f7a87d14cb0): created successfully Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89960efb-2855-4a34-ae5e-4252cb3c74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Flow 'volume_create_manager' (2636af4d-cdb0-4260-b45b-e56592a07266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6ee9d4d0-86ed-4242-902d-f450bb565638 tempest-DeleteServersTestJSON-1687269563 None] Created volume successfully. Sep 01 02:02:32 devstack cinder-volume[86925]: WARNING py.warnings [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 01 02:02:32 devstack cinder-volume[86925]: .first() Sep 01 02:02:32 devstack cinder-volume[86925]: Sep 01 02:02:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-419798f4-8d34-469b-8a67-4f7a87d14cb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e00311b-8c0c-4cfc-9948-6d704964e03c', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:02:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-f1470f82-513d-41d2-8eab-967254dd932e req-f69ba09d-411e-4f81-a7a5-cbf3998fbf8d tempest-DeleteServersTestJSON-1687269563 None] attachment_update completed successfully. Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Flow 'volume_create_manager' (586bbc0f-7f38-4dec-8e2e-0d29ef6fb418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d353e7-31fd-4044-8c8d-cc3b3ecb5d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d353e7-31fd-4044-8c8d-cc3b3ecb5d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687337529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341d6080-112f-45b4-b023-612a32ef9b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29618296eb3a4bbc93710f3427b58cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:36Z,use_quota=True,user_id='6585aa8fb7ee4ab595beb219596a0d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d5a0a0-afd2-4d98-a862-7276c4c253a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d5a0a0-afd2-4d98-a862-7276c4c253a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5526ec-8c13-4565-8c1a-5e72fb0bba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5526ec-8c13-4565-8c1a-5e72fb0bba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341d6080-112f-45b4-b023-612a32ef9b13', 'volume_name': 'volume-341d6080-112f-45b4-b023-612a32ef9b13', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f6d3ec-ed6e-424b-8909-700dea38be7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f6d3ec-ed6e-424b-8909-700dea38be7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8203d247-ec7c-4992-8798-4bc05a458603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Volume 341d6080-112f-45b4-b023-612a32ef9b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341d6080-112f-45b4-b023-612a32ef9b13', 'volume_size': 1} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687337529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341d6080-112f-45b4-b023-612a32ef9b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29618296eb3a4bbc93710f3427b58cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:36Z,use_quota=True,user_id='6585aa8fb7ee4ab595beb219596a0d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Creating volume 341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:36 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:02:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:36 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 1073741824 Sep 01 02:02:36 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:37 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 1073741824" returned: 0 in 0.552s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:37 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:02:37 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:37 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.332s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8203d247-ec7c-4992-8798-4bc05a458603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341d6080-112f-45b4-b023-612a32ef9b13', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7dd78-ff3c-4186-97d6-3ce0e75c9cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Volume volume-341d6080-112f-45b4-b023-612a32ef9b13 (341d6080-112f-45b4-b023-612a32ef9b13): created successfully Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7dd78-ff3c-4186-97d6-3ce0e75c9cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Flow 'volume_create_manager' (586bbc0f-7f38-4dec-8e2e-0d29ef6fb418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-71301218-5dbe-4ae6-84c3-421971d4e3bc tempest-VolumesActionsTest-1369442480 None] Created volume successfully. Sep 01 02:02:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-8f13e545-1ae0-44f1-8275-a75f52dcc4c3 req-55fc2e18-6769-4ce8-b115-c9f59838dde0 tempest-DeleteServersTestJSON-1687269563 None] Terminate volume connection completed successfully. Sep 01 02:02:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-8f13e545-1ae0-44f1-8275-a75f52dcc4c3 req-55fc2e18-6769-4ce8-b115-c9f59838dde0 tempest-DeleteServersTestJSON-1687269563 None] Deleting attachment 4e00311b-8c0c-4cfc-9948-6d704964e03c. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:40 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:02:40 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:41 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.905s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 8 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:02:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:02:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "cinder-419798f4-8d34-469b-8a67-4f7a87d14cb0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "cinder-419798f4-8d34-469b-8a67-4f7a87d14cb0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "cinder-quobyte-419798f4-8d34-469b-8a67-4f7a87d14cb0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "cinder-quobyte-419798f4-8d34-469b-8a67-4f7a87d14cb0" acquired by "delete_volume" :: waited 0.048s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed3672-1c2f-434e-88cd-6afa04ba1a11]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:43 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 Sep 01 02:02:43 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0" returned: 0 in 1.117s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0 Sep 01 02:02:44 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:45 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-419798f4-8d34-469b-8a67-4f7a87d14cb0" returned: 0 in 0.783s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "cinder-quobyte-419798f4-8d34-469b-8a67-4f7a87d14cb0" released by "delete_volume" :: held 2.000s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Created reservations ['dfe5fb0d-d049-4baf-af6b-f8165350698b', 'eab3e47a-1ce8-400b-ab7a-29c603247d3d', '2406c687-bec0-431d-b849-743dae3f49f8', '51fd9a37-f66b-4158-9112-1fa7d8aa8bcc'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:45 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:02:45 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.659s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Deleted volume successfully. Sep 01 02:02:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9fc18d44-b67f-49ec-ae6e-c5e7821dc4db tempest-DeleteServersTestJSON-1687269563 None] Lock "cinder-419798f4-8d34-469b-8a67-4f7a87d14cb0-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:55 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:56 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=19,cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-427e0a5b-4d23-4b4d-b7a7-8ef02e513846 tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" by "attach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-427e0a5b-4d23-4b4d-b7a7-8ef02e513846 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" acquired by "attach_volume" :: waited 0.070s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-427e0a5b-4d23-4b4d-b7a7-8ef02e513846 tempest-VolumesActionsTest-1369442480 None] Attaching volume 341d6080-112f-45b4-b023-612a32ef9b13 to instance c4c59234-f856-414e-9c4f-650a870342a5 at mountpoint /dev/vdb on host None. Sep 01 02:03:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-427e0a5b-4d23-4b4d-b7a7-8ef02e513846 tempest-VolumesActionsTest-1369442480 None] Attach volume completed successfully. Sep 01 02:03:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-427e0a5b-4d23-4b4d-b7a7-8ef02e513846 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" released by "attach_volume" :: held 0.255s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-940f43fc-4cd8-4fc7-a174-64368d632630 tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" by "detach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-940f43fc-4cd8-4fc7-a174-64368d632630 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-940f43fc-4cd8-4fc7-a174-64368d632630 tempest-VolumesActionsTest-1369442480 None] Detaching volume 341d6080-112f-45b4-b023-612a32ef9b13 from instance c4c59234-f856-414e-9c4f-650a870342a5. Sep 01 02:03:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-940f43fc-4cd8-4fc7-a174-64368d632630 tempest-VolumesActionsTest-1369442480 None] Detach volume completed successfully. Sep 01 02:03:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-940f43fc-4cd8-4fc7-a174-64368d632630 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Flow 'volume_create_manager' (c4b795f1-129b-43fe-aff2-9fb62b01e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb07f702-9848-4255-930e-a4bf8e470d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb07f702-9848-4255-930e-a4bf8e470d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-641545006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d85e82-8831-4fdc-baa2-1a4200d7618e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08811bb09416464db1669605f6ebf154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:06Z,use_quota=True,user_id='292c1f9d8a694d75b7c69b9523b7a9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3448a637-33bc-4e9b-a8cf-ea55ec062031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3448a637-33bc-4e9b-a8cf-ea55ec062031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a580c9e7-3afd-447a-b52f-c0c5d34be75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a580c9e7-3afd-447a-b52f-c0c5d34be75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d85e82-8831-4fdc-baa2-1a4200d7618e', 'volume_name': 'volume-13d85e82-8831-4fdc-baa2-1a4200d7618e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c53e4e-6a8e-4804-83fd-fa3f2a95b13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c53e4e-6a8e-4804-83fd-fa3f2a95b13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4e0d73-c0e2-468a-a29a-740dfb8e66a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Volume 13d85e82-8831-4fdc-baa2-1a4200d7618e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d85e82-8831-4fdc-baa2-1a4200d7618e', 'volume_size': 1} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-641545006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d85e82-8831-4fdc-baa2-1a4200d7618e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08811bb09416464db1669605f6ebf154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:06Z,use_quota=True,user_id='292c1f9d8a694d75b7c69b9523b7a9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Creating volume 13d85e82-8831-4fdc-baa2-1a4200d7618e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:06 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:03:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:06 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e 1073741824 Sep 01 02:03:06 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:07 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e 1073741824" returned: 0 in 0.881s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:07 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e Sep 01 02:03:07 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:08 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e" returned: 0 in 0.597s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4e0d73-c0e2-468a-a29a-740dfb8e66a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d85e82-8831-4fdc-baa2-1a4200d7618e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38536ec8-88c7-4fc3-96fa-b1e8c8b6c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:08 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Volume volume-13d85e82-8831-4fdc-baa2-1a4200d7618e (13d85e82-8831-4fdc-baa2-1a4200d7618e): created successfully Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38536ec8-88c7-4fc3-96fa-b1e8c8b6c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Flow 'volume_create_manager' (c4b795f1-129b-43fe-aff2-9fb62b01e646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f36bf655-63fa-417a-aca6-6691bc5c249a tempest-ServerRescueNegativeTestJSON-2131880731 None] Created volume successfully. Sep 01 02:03:18 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:18 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-40349cf3-ebbd-4c7f-89ba-1d4d506513fc tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" by "attach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-40349cf3-ebbd-4c7f-89ba-1d4d506513fc tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" acquired by "attach_volume" :: waited 0.053s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-40349cf3-ebbd-4c7f-89ba-1d4d506513fc tempest-VolumesActionsTest-1369442480 None] Attaching volume 341d6080-112f-45b4-b023-612a32ef9b13 to instance 204ebc4f-5415-4411-9686-a53dac0d4265 at mountpoint /dev/vdb on host None. Sep 01 02:03:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-40349cf3-ebbd-4c7f-89ba-1d4d506513fc tempest-VolumesActionsTest-1369442480 None] Attach volume completed successfully. Sep 01 02:03:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-40349cf3-ebbd-4c7f-89ba-1d4d506513fc tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13" released by "attach_volume" :: held 0.437s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2885bb97-151c-45c7-a909-5c8242f027b6 tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" by "detach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2885bb97-151c-45c7-a909-5c8242f027b6 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2885bb97-151c-45c7-a909-5c8242f027b6 tempest-VolumesActionsTest-1369442480 None] Detaching volume 341d6080-112f-45b4-b023-612a32ef9b13 from instance 204ebc4f-5415-4411-9686-a53dac0d4265. Sep 01 02:03:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2885bb97-151c-45c7-a909-5c8242f027b6 tempest-VolumesActionsTest-1369442480 None] Detach volume completed successfully. Sep 01 02:03:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2885bb97-151c-45c7-a909-5c8242f027b6 tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (9e2db697-3a1c-4226-b99e-609eda7cf057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70517fb4-2c5b-46b4-84ef-2523643e7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70517fb4-2c5b-46b4-84ef-2523643e7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1248746354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb8392-bb76-4289-81dc-2bc43ced503c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:27Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7016c-18b0-4c95-b878-c97ebc90859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7016c-18b0-4c95-b878-c97ebc90859a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c672c1-2ecf-4e78-803b-43353cc37492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c672c1-2ecf-4e78-803b-43353cc37492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fb8392-bb76-4289-81dc-2bc43ced503c', 'volume_name': 'volume-a6fb8392-bb76-4289-81dc-2bc43ced503c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee846c8-fac2-4b3e-ba1b-1e56a490e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee846c8-fac2-4b3e-ba1b-1e56a490e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609a6721-87c6-4dde-ab02-c7590c642fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Volume a6fb8392-bb76-4289-81dc-2bc43ced503c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fb8392-bb76-4289-81dc-2bc43ced503c', 'volume_size': 1} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1248746354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb8392-bb76-4289-81dc-2bc43ced503c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:27Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Creating volume a6fb8392-bb76-4289-81dc-2bc43ced503c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:26 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:03:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:26 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c 1073741824 Sep 01 02:03:26 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:27 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c 1073741824" returned: 0 in 0.864s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:27 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c Sep 01 02:03:27 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c" returned: 0 in 0.433s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609a6721-87c6-4dde-ab02-c7590c642fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fb8392-bb76-4289-81dc-2bc43ced503c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fc5c7b-e806-4f39-9294-20c37fdb2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Volume volume-a6fb8392-bb76-4289-81dc-2bc43ced503c (a6fb8392-bb76-4289-81dc-2bc43ced503c): created successfully Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fc5c7b-e806-4f39-9294-20c37fdb2535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (9e2db697-3a1c-4226-b99e-609eda7cf057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b55f51ff-f3ef-4c26-9d70-87652cd23cb7 tempest-AttachVolumeNegativeTest-845487143 None] Created volume successfully. Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Acquiring lock "cinder-13d85e82-8831-4fdc-baa2-1a4200d7618e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "cinder-13d85e82-8831-4fdc-baa2-1a4200d7618e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Acquiring lock "cinder-quobyte-13d85e82-8831-4fdc-baa2-1a4200d7618e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "cinder-quobyte-13d85e82-8831-4fdc-baa2-1a4200d7618e" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d3fe7b-222b-47d7-a699-c9709577bee4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e Sep 01 02:03:29 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:29 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e" returned: 0 in 0.708s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e Sep 01 02:03:29 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-13d85e82-8831-4fdc-baa2-1a4200d7618e" returned: 0 in 0.514s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "cinder-quobyte-13d85e82-8831-4fdc-baa2-1a4200d7618e" released by "delete_volume" :: held 1.297s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Created reservations ['94d1fbb9-c7eb-4f0f-9241-9338d6bee15f', '83591124-6792-43d0-9513-45aa9f38035e', '09b18c16-0dab-40ee-97a5-4dccaef1d662', '809a1fc1-d0c6-4626-9813-b73412add031'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:30 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:03:30 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:31 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.466s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Deleted volume successfully. Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da25372c-1108-4c76-83cf-3bf8dfce852c tempest-ServerRescueNegativeTestJSON-2131880731 None] Lock "cinder-13d85e82-8831-4fdc-baa2-1a4200d7618e-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-6a274bff-9dbb-41ba-bf75-3ff188e9d494 req-80d2389b-5a37-4870-a52c-890a8d24b75f tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-6a274bff-9dbb-41ba-bf75-3ff188e9d494 req-80d2389b-5a37-4870-a52c-890a8d24b75f tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-6a274bff-9dbb-41ba-bf75-3ff188e9d494 req-80d2389b-5a37-4870-a52c-890a8d24b75f tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-6a274bff-9dbb-41ba-bf75-3ff188e9d494 req-80d2389b-5a37-4870-a52c-890a8d24b75f tempest-AttachVolumeNegativeTest-845487143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-a6fb8392-bb76-4289-81dc-2bc43ced503c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4267ac3b-15ce-4acb-a793-4651b02a2108', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-6a274bff-9dbb-41ba-bf75-3ff188e9d494 req-80d2389b-5a37-4870-a52c-890a8d24b75f tempest-AttachVolumeNegativeTest-845487143 None] attachment_update completed successfully. Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be8e2be-a884-46d0-ae89-792e08c7665c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:32 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:03:32 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:32 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 1.045s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3719d-1ff2-48fb-b304-0860f5736524]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:33 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:03:33 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:33 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.833s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.9ba3ea9c-16be-4f0e-9c9b-45c90ce66593qcbtx2q_.img {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:33 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.9ba3ea9c-16be-4f0e-9c9b-45c90ce66593qcbtx2q_.img Sep 01 02:03:33 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:40 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:03:40 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.505s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 8 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:41 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.9ba3ea9c-16be-4f0e-9c9b-45c90ce66593qcbtx2q_.img" returned: 0 in 8.179s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9e06d-a542-474b-bb24-c52f3f20f118]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:41 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:03:41 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.576s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13, size 1024.00 MB, duration 8.18 sec, destination /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.9ba3ea9c-16be-4f0e-9c9b-45c90ce66593qcbtx2q_.img {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:03:42 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Converted 1024.00 MB image at 125.18 MB/s Sep 01 02:03:42 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] 9ba3ea9c-16be-4f0e-9c9b-45c90ce66593 was raw, no need to convert to raw {{(pid=86925) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:03:52 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:52 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Flow 'volume_create_manager' (546bbafe-851b-4ece-937e-c5ce7d382fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e98faae-8e8b-43b1-9f1d-1c9c1d5aa604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e98faae-8e8b-43b1-9f1d-1c9c1d5aa604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1109925527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcc1beb-aa0b-4036-a203-548a018f0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7505152ebf4208a866b1d8997c0277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:55Z,use_quota=True,user_id='7547e09be16840eeaeafab6c4967a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240cdb48-4008-43c5-aabd-e75ba4b35ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240cdb48-4008-43c5-aabd-e75ba4b35ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056fd115-ec36-48f5-8a19-5bad071b35c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056fd115-ec36-48f5-8a19-5bad071b35c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcc1beb-aa0b-4036-a203-548a018f0454', 'volume_name': 'volume-7dcc1beb-aa0b-4036-a203-548a018f0454', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98493ee3-f921-4d34-8fcd-345a0841dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98493ee3-f921-4d34-8fcd-345a0841dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ef20a-923c-4af4-9161-66eaf4f11dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Volume 7dcc1beb-aa0b-4036-a203-548a018f0454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcc1beb-aa0b-4036-a203-548a018f0454', 'volume_size': 1} Sep 01 02:03:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:04 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:04 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.368s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Uploaded volume to glance image-id: 9ba3ea9c-16be-4f0e-9c9b-45c90ce66593. {{(pid=86925) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.259s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1109925527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcc1beb-aa0b-4036-a203-548a018f0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7505152ebf4208a866b1d8997c0277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:55Z,use_quota=True,user_id='7547e09be16840eeaeafab6c4967a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Creating volume 7dcc1beb-aa0b-4036-a203-548a018f0454 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:11 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2a9b82f1-e8b2-49f7-bb8c-e525a647a737 tempest-VolumesActionsTest-1369442480 None] Copy volume to image completed successfully. Sep 01 02:04:11 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 1073741824 Sep 01 02:04:11 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:11 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 1073741824" returned: 0 in 0.599s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:11 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 Sep 01 02:04:11 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454" returned: 0 in 0.332s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ef20a-923c-4af4-9161-66eaf4f11dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcc1beb-aa0b-4036-a203-548a018f0454', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bc31fd-5150-4c16-9bcf-05a645d7360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Volume volume-7dcc1beb-aa0b-4036-a203-548a018f0454 (7dcc1beb-aa0b-4036-a203-548a018f0454): created successfully Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bc31fd-5150-4c16-9bcf-05a645d7360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Flow 'volume_create_manager' (546bbafe-851b-4ece-937e-c5ce7d382fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-900adae5-b990-472a-a2ea-feccdac335c4 tempest-TaggedAttachmentsTest-1493972653 None] Created volume successfully. Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f1422-f0b5-47c4-afb9-cdadc9e0b1d8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:04:12 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:13 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a3f41-29b4-4f71-8236-cd26128c7b66]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:13 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:04:13 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:13 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:13 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img Sep 01 02:04:13 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img" returned: 0 in 5.858s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec6adce-34d4-4c3d-b681-4b5d3a1bb946]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:04:19 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.701s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:20 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Converted 1024.00 MB image at 174.67 MB/s Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] e0811a14-987d-48e9-a8a8-1d28d56660ac was raw, converting to qcow2 {{(pid=86925) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[48601ca7-a655-4fd9-90c9-ed65df2d00f7]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img Sep 01 02:04:20 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img" returned: 0 in 0.405s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img Sep 01 02:04:20 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img" returned: 1 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:04:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img /opt/stack/data/cinder/conversion/vol_upload_ox_fa129 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img /opt/stack/data/cinder/conversion/vol_upload_ox_fa129 Sep 01 02:04:20 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img /opt/stack/data/cinder/conversion/vol_upload_ox_fa129" returned: 0 in 0.419s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Image conversion details: src /opt/stack/data/cinder/conversion/341d6080-112f-45b4-b023-612a32ef9b13.temp_image.e0811a14-987d-48e9-a8a8-1d28d56660aczysgvgjh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ox_fa129 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:21 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 02:04:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[18535276-47a4-4116-b9ce-d27ae59133d5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ox_fa129 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ox_fa129 Sep 01 02:04:21 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:22 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ox_fa129" returned: 0 in 0.811s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.884s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Uploaded volume to glance image-id: e0811a14-987d-48e9-a8a8-1d28d56660ac. {{(pid=86925) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:04:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a0018048-592a-4bcb-9796-0771611bd00c tempest-VolumesActionsTest-1369442480 None] Copy volume to image completed successfully. Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Acquiring lock "cinder-quobyte-341d6080-112f-45b4-b023-612a32ef9b13" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "cinder-quobyte-341d6080-112f-45b4-b023-612a32ef9b13" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197168b-24a4-4db2-a6c4-bd1c896c3678]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:26 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:04:26 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:26 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.762s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:26 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13 Sep 01 02:04:26 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:27 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-341d6080-112f-45b4-b023-612a32ef9b13" returned: 0 in 0.431s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "cinder-quobyte-341d6080-112f-45b4-b023-612a32ef9b13" released by "delete_volume" :: held 1.278s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Created reservations ['7740acc5-be72-4bb0-86bd-2ea69f337742', '62dd99d0-67e3-414e-be77-7557504592da', 'a4d547e1-abd9-4558-9d1f-2dbf15824bc8', 'ee8cedc5-57b9-4fb0-bf6d-5b1a1f5a2d6b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:27 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:04:27 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:27 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.481s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Deleted volume successfully. Sep 01 02:04:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e5b46c10-780d-4009-9f1f-560c5a5c6daa tempest-VolumesActionsTest-1369442480 None] Lock "cinder-341d6080-112f-45b4-b023-612a32ef9b13-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-8fedea1c-f086-4ebe-8ec0-4922740ddf27 req-fa20383d-e1ac-44c4-9c6a-df818394de61 tempest-AttachVolumeNegativeTest-845487143 None] Terminate volume connection completed successfully. Sep 01 02:04:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-8fedea1c-f086-4ebe-8ec0-4922740ddf27 req-fa20383d-e1ac-44c4-9c6a-df818394de61 tempest-AttachVolumeNegativeTest-845487143 None] Deleting attachment 4267ac3b-15ce-4acb-a793-4651b02a2108. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:40 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:04:40 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.402s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Flow 'volume_create_manager' (b6c7a97e-65fe-4df5-a12e-50fbef4177e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c44e5ae-f8dc-4a8f-b59b-68dc6728776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c44e5ae-f8dc-4a8f-b59b-68dc6728776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2004737465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a521285-638a-4fe3-a2b3-8f6826655ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90a0eb90dc74f499c6cb9bde0373034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:42Z,use_quota=True,user_id='6809f473dcc9435b91cda82c1deb1901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac6f697-aa21-47f0-bda5-e5b09bd0e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac6f697-aa21-47f0-bda5-e5b09bd0e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383e9a3-dd33-4351-bc8e-9d3bbb1e32f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383e9a3-dd33-4351-bc8e-9d3bbb1e32f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a521285-638a-4fe3-a2b3-8f6826655ea5', 'volume_name': 'volume-3a521285-638a-4fe3-a2b3-8f6826655ea5', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84960041-609a-4902-ac37-4246ca97f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84960041-609a-4902-ac37-4246ca97f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e364c3-f3f1-48a2-84c1-5e7ea3435b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Volume 3a521285-638a-4fe3-a2b3-8f6826655ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a521285-638a-4fe3-a2b3-8f6826655ea5', 'volume_size': 1} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2004737465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a521285-638a-4fe3-a2b3-8f6826655ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90a0eb90dc74f499c6cb9bde0373034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:42Z,use_quota=True,user_id='6809f473dcc9435b91cda82c1deb1901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Creating volume 3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:41 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:04:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 1073741824 Sep 01 02:04:42 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 1073741824" returned: 0 in 0.521s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:04:42 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.290s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e364c3-f3f1-48a2-84c1-5e7ea3435b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a521285-638a-4fe3-a2b3-8f6826655ea5', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf8d158-26c9-43aa-a921-76a37af36865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Volume volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 (3a521285-638a-4fe3-a2b3-8f6826655ea5): created successfully Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf8d158-26c9-43aa-a921-76a37af36865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Flow 'volume_create_manager' (b6c7a97e-65fe-4df5-a12e-50fbef4177e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dc056f53-c631-468f-9368-c1e1b45ca531 tempest-VolumesCloneTest-1950276450 None] Created volume successfully. Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Flow 'volume_create_manager' (c6067a25-9c6d-44a9-aab6-ba6a758f38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e3e53-d370-4124-95c4-9b55eb489bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e3e53-d370-4124-95c4-9b55eb489bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1774929998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fcf336-bfc3-4bfe-80e0-da7900465a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90a0eb90dc74f499c6cb9bde0373034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3a521285-638a-4fe3-a2b3-8f6826655ea5,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:44Z,use_quota=True,user_id='6809f473dcc9435b91cda82c1deb1901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425cf276-0cd5-4125-ade0-f80d6bb03062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425cf276-0cd5-4125-ade0-f80d6bb03062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365ade9-67df-43bf-8bc2-b124f9efbddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365ade9-67df-43bf-8bc2-b124f9efbddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89fcf336-bfc3-4bfe-80e0-da7900465a33', 'volume_name': 'volume-89fcf336-bfc3-4bfe-80e0-da7900465a33', 'volume_size': 2, 'source_volid': '3a521285-638a-4fe3-a2b3-8f6826655ea5', 'source_volstatus': 'available'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78527700-c2e8-48f2-839f-6ed103a5435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78527700-c2e8-48f2-839f-6ed103a5435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773377c-0848-4bea-bc0d-0f79cd8e46d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Volume 89fcf336-bfc3-4bfe-80e0-da7900465a33: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89fcf336-bfc3-4bfe-80e0-da7900465a33', 'volume_size': 2, 'source_volid': '3a521285-638a-4fe3-a2b3-8f6826655ea5', 'source_volstatus': 'available'} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:44 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Cloning volume 3a521285-638a-4fe3-a2b3-8f6826655ea5 to volume 89fcf336-bfc3-4bfe-80e0-da7900465a33 Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Creating offline snapshot e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 of volume 3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e9d3e0-afeb-4a47-bb1a-b469bc61daff]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:04:44 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.364s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 1G Sep 01 02:04:45 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 1G" returned: 0 in 0.486s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:45 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.323s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 is being set with open permissions: ugo+rw Sep 01 02:04:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:45 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info Sep 01 02:04:46 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info is being set with open permissions: ugo+rw Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info Sep 01 02:04:46 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.info" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] snapshot: e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927, volume: 89fcf336-bfc3-4bfe-80e0-da7900465a33, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d885e9-7ecb-4d4e-acc4-040a463637be]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:47 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.562s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a521285-638a-4fe3-a2b3-8f6826655ea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abb66f-2797-4c7d-8df0-c178688a43c1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:04:47 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.437s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:04:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:04:48 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:04:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 Sep 01 02:04:48 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:54 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33" returned: 0 in 6.740s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:54 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:54 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Converted 1024.00 MB image at 151.91 MB/s Sep 01 02:04:54 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 is being set with open permissions: ugo+rw Sep 01 02:04:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:54 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 Sep 01 02:04:54 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Flow 'volume_create_manager' (7a0554b4-de9d-4d3e-9ac4-4f7ea2583b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:55 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dff63f5-511c-4ac8-b9dd-580cd5def7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33" returned: 0 in 0.296s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dff63f5-511c-4ac8-b9dd-580cd5def7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1937379260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa89731-5e25-4f13-a44a-e51e0f48edb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7974e08937c8424e937a42134ce1360b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:55Z,use_quota=True,user_id='61d1194cbf9a45fe8791cb03a06f3d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30a243-cb03-4512-b973-1a88a1ef1d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30a243-cb03-4512-b973-1a88a1ef1d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76bfc4-1744-4d59-a260-05dab930249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76bfc4-1744-4d59-a260-05dab930249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa89731-5e25-4f13-a44a-e51e0f48edb3', 'volume_name': 'volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc531565-7afd-491f-9524-1e3a948bb437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc531565-7afd-491f-9524-1e3a948bb437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc45a8e-5fd5-46bb-a0cf-d5e77f008205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Volume 9fa89731-5e25-4f13-a44a-e51e0f48edb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3', 'volume_size': 1} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" released by "_copy_volume_from_snapshot" :: held 8.201s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-quobyte-e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Deleting offline snapshot e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 of volume 3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] snapshot_file for this snap is: volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5033c68d-adcd-4ad2-b869-b969bbc6fc5e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:55 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:55 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:55 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.546s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a521285-638a-4fe3-a2b3-8f6826655ea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f723ae-6098-4f85-b58a-b501324b4a44]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:56 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:04:56 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:56 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.650s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:56 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:56 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:57 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.475s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:57 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927 Sep 01 02:04:57 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:57 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5.e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" returned: 0 in 0.327s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-e580bfd7-4ba5-4fbe-95e7-e4ca8fab8927" released by "_delete_snapshot" :: held 2.124s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.702s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.210s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1937379260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa89731-5e25-4f13-a44a-e51e0f48edb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7974e08937c8424e937a42134ce1360b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:55Z,use_quota=True,user_id='61d1194cbf9a45fe8791cb03a06f3d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Creating volume 9fa89731-5e25-4f13-a44a-e51e0f48edb3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:57 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:57 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 1073741824 Sep 01 02:04:57 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773377c-0848-4bea-bc0d-0f79cd8e46d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fcf336-bfc3-4bfe-80e0-da7900465a33', 'volume_size': 2, 'source_volid': '3a521285-638a-4fe3-a2b3-8f6826655ea5', 'source_volstatus': 'available'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5dc78f-bbf2-4850-9e1d-c6c72743feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:57 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Volume volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 (89fcf336-bfc3-4bfe-80e0-da7900465a33): created successfully Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5dc78f-bbf2-4850-9e1d-c6c72743feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Flow 'volume_create_manager' (c6067a25-9c6d-44a9-aab6-ba6a758f38a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b48702b6-2cea-4065-b4f2-63968665d117 tempest-VolumesCloneTest-1950276450 None] Created volume successfully. Sep 01 02:04:57 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 1073741824" returned: 0 in 0.546s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:58 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 Sep 01 02:04:58 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:58 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc45a8e-5fd5-46bb-a0cf-d5e77f008205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613789a0-24d6-4dfc-bdc2-a470ad7e7089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:58 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Volume volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 (9fa89731-5e25-4f13-a44a-e51e0f48edb3): created successfully Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613789a0-24d6-4dfc-bdc2-a470ad7e7089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Flow 'volume_create_manager' (7a0554b4-de9d-4d3e-9ac4-4f7ea2583b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-89fcf336-bfc3-4bfe-80e0-da7900465a33-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:58 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-96407e3e-4fd4-4b6d-83ad-ac41ade95674 tempest-AttachVolumeShelveTestJSON-670903292 None] Created volume successfully. Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-89fcf336-bfc3-4bfe-80e0-da7900465a33-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b824c0-75c2-4c41-b69b-b9f7aa0b79ce]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:58 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 Sep 01 02:04:58 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:58 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33" returned: 0 in 0.386s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:58 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33 Sep 01 02:04:58 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:59 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-89fcf336-bfc3-4bfe-80e0-da7900465a33" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-89fcf336-bfc3-4bfe-80e0-da7900465a33" released by "delete_volume" :: held 0.677s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Created reservations ['6f5a32ad-121b-4ee5-8245-13760a6dcb95', '71201100-3b33-468f-be38-32c2ea57785a', 'fe2f5364-b680-45d9-ac61-0a09f42dd666', '11e94bd0-7511-4f57-b113-fe41c562539a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:59 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:04:59 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:59 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.301s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Deleted volume successfully. Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-05ec82e2-d1ea-4d31-a802-d35d03dabba5 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-89fcf336-bfc3-4bfe-80e0-da7900465a33-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-3a521285-638a-4fe3-a2b3-8f6826655ea5-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-3a521285-638a-4fe3-a2b3-8f6826655ea5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "cinder-quobyte-3a521285-638a-4fe3-a2b3-8f6826655ea5" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-3a521285-638a-4fe3-a2b3-8f6826655ea5" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e987dd72-5d38-491a-8f05-145c8c056a7f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:59 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:04:59 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:00 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:00 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5 Sep 01 02:05:00 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:00 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3a521285-638a-4fe3-a2b3-8f6826655ea5" returned: 0 in 0.326s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-quobyte-3a521285-638a-4fe3-a2b3-8f6826655ea5" released by "delete_volume" :: held 0.890s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Created reservations ['b083d611-73bf-4639-9df7-11c6359d642d', 'a3fca428-3e04-44c1-96b7-787f119b8047', 'c44bc30a-5a31-431b-8b14-804760e72fff', '12a7a02b-1b48-454a-9510-e4a1a4e390aa'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:00 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:05:00 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:01 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.667s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:01 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:01 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Deleted volume successfully. Sep 01 02:05:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e0fb2076-5e60-4201-a5e9-1f82c86d9991 tempest-VolumesCloneTest-1950276450 None] Lock "cinder-3a521285-638a-4fe3-a2b3-8f6826655ea5-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Flow 'volume_create_manager' (51981de2-351a-4224-85cc-01425a4e4d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad39034-45b1-43c2-90bd-96b6e42cf7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad39034-45b1-43c2-90bd-96b6e42cf7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2009880148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4136b94-3f8b-42e8-bf90-593ee1de86d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a99c7f893e34bae9756cdc455e28cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:07Z,use_quota=True,user_id='6ffa5823e7c74255ba9ecb183bac4d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75de8d9-06b5-4bca-9287-2496877499cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75de8d9-06b5-4bca-9287-2496877499cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617ff50-5a59-47ce-928c-56e70670421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617ff50-5a59-47ce-928c-56e70670421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4136b94-3f8b-42e8-bf90-593ee1de86d1', 'volume_name': 'volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1', 'volume_size': 2}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f036709-9d3e-4a72-b249-163283080233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f036709-9d3e-4a72-b249-163283080233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3732ea44-107f-4616-8be8-4e3972626c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Volume f4136b94-3f8b-42e8-bf90-593ee1de86d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1', 'volume_size': 2} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2009880148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4136b94-3f8b-42e8-bf90-593ee1de86d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a99c7f893e34bae9756cdc455e28cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:07Z,use_quota=True,user_id='6ffa5823e7c74255ba9ecb183bac4d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Creating volume f4136b94-3f8b-42e8-bf90-593ee1de86d1 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:07 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 2147483648 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:07 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 2147483648 Sep 01 02:05:07 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3cfece43-73cd-4653-92e2-c4e848679bf5 req-2f559dc4-67d4-4b4a-a4cf-cfddc3e73543 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:07 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 2147483648" returned: 0 in 0.782s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:07 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 Sep 01 02:05:07 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:08 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3cfece43-73cd-4653-92e2-c4e848679bf5 req-2f559dc4-67d4-4b4a-a4cf-cfddc3e73543 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.326s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3732ea44-107f-4616-8be8-4e3972626c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1', 'volume_size': 2}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59328e29-1e57-4b63-a1ca-c6acc414735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3cfece43-73cd-4653-92e2-c4e848679bf5 req-2f559dc4-67d4-4b4a-a4cf-cfddc3e73543 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:08 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Volume volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 (f4136b94-3f8b-42e8-bf90-593ee1de86d1): created successfully Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59328e29-1e57-4b63-a1ca-c6acc414735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Flow 'volume_create_manager' (51981de2-351a-4224-85cc-01425a4e4d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ccde62ce-3dd4-4347-939b-d9e8f771314c tempest-VolumesCloneNegativeTest-1387565132 None] Created volume successfully. Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-3cfece43-73cd-4653-92e2-c4e848679bf5 req-2f559dc4-67d4-4b4a-a4cf-cfddc3e73543 tempest-TaggedAttachmentsTest-1493972653 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-7dcc1beb-aa0b-4036-a203-548a018f0454', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3650106-e207-454d-b2ef-403413203532', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-3cfece43-73cd-4653-92e2-c4e848679bf5 req-2f559dc4-67d4-4b4a-a4cf-cfddc3e73543 tempest-TaggedAttachmentsTest-1493972653 None] attachment_update completed successfully. Sep 01 02:05:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Acquiring lock "cinder-f4136b94-3f8b-42e8-bf90-593ee1de86d1-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "cinder-f4136b94-3f8b-42e8-bf90-593ee1de86d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Acquiring lock "cinder-quobyte-f4136b94-3f8b-42e8-bf90-593ee1de86d1" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "cinder-quobyte-f4136b94-3f8b-42e8-bf90-593ee1de86d1" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8820f-0c21-4b87-bd8f-fa217c63e977]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:09 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 Sep 01 02:05:09 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:09 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:09 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1 Sep 01 02:05:09 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:09 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f4136b94-3f8b-42e8-bf90-593ee1de86d1" returned: 0 in 0.466s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "cinder-quobyte-f4136b94-3f8b-42e8-bf90-593ee1de86d1" released by "delete_volume" :: held 0.919s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Created reservations ['166f4379-f843-4a20-93d8-52e69cd962ed', '50fa76b6-4771-4e4d-b8ee-d49d6920d530', '13c77e29-36f9-498b-8ef9-fdda9d2e9afe', 'ead72697-0215-45a4-9beb-b41aa1c3988a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:10 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:05:10 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:10 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.313s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Deleted volume successfully. Sep 01 02:05:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e74160e8-42cf-40eb-bc9d-ebca9465ed6b tempest-VolumesCloneNegativeTest-1387565132 None] Lock "cinder-f4136b94-3f8b-42e8-bf90-593ee1de86d1-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-8e9f16d9-f49e-418d-afba-4f198fe75454 req-1e829747-e885-4a0f-9abb-4c5bc4a2229c tempest-TaggedAttachmentsTest-1493972653 None] Terminate volume connection completed successfully. Sep 01 02:05:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-8e9f16d9-f49e-418d-afba-4f198fe75454 req-1e829747-e885-4a0f-9abb-4c5bc4a2229c tempest-TaggedAttachmentsTest-1493972653 None] Deleting attachment d3650106-e207-454d-b2ef-403413203532. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-da502f73-43ab-4935-ab8d-d9454a785407 req-1b3b2fa5-ce18-476a-9fbf-57aa90fcc803 tempest-AttachVolumeShelveTestJSON-670903292 None] No connector for attachment d34a08aa-eb88-419f-87c9-ff62b8e45e77; skipping storage backend terminate_connection call. {{(pid=86925) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 02:05:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-da502f73-43ab-4935-ab8d-d9454a785407 req-1b3b2fa5-ce18-476a-9fbf-57aa90fcc803 tempest-AttachVolumeShelveTestJSON-670903292 None] Deleting attachment d34a08aa-eb88-419f-87c9-ff62b8e45e77. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (b7dc40ed-465a-4683-881e-0914a18a74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71692e85-105e-4294-94e4-04d5ad65021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71692e85-105e-4294-94e4-04d5ad65021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1397712181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c913d12-ea43-4d14-b91d-94c785b52aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:19Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6bc55-badd-4298-910a-4c7c83ff2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6bc55-badd-4298-910a-4c7c83ff2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9b8eb-ba5c-4bfd-ab3e-f686f9766963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9b8eb-ba5c-4bfd-ab3e-f686f9766963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c913d12-ea43-4d14-b91d-94c785b52aaf', 'volume_name': 'volume-9c913d12-ea43-4d14-b91d-94c785b52aaf', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ff98c9-8ecf-4a0b-8cf2-25c7b0c277e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ff98c9-8ecf-4a0b-8cf2-25c7b0c277e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed25340-c618-426a-931a-b4509d7a96e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Volume 9c913d12-ea43-4d14-b91d-94c785b52aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c913d12-ea43-4d14-b91d-94c785b52aaf', 'volume_size': 1} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1397712181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c913d12-ea43-4d14-b91d-94c785b52aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:19Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Creating volume 9c913d12-ea43-4d14-b91d-94c785b52aaf {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:19 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf 1073741824 Sep 01 02:05:19 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf 1073741824" returned: 0 in 0.599s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:20 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf Sep 01 02:05:20 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:20 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed25340-c618-426a-931a-b4509d7a96e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c913d12-ea43-4d14-b91d-94c785b52aaf', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcfe5da-d68b-4691-bdfa-e0c893123fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Volume volume-9c913d12-ea43-4d14-b91d-94c785b52aaf (9c913d12-ea43-4d14-b91d-94c785b52aaf): created successfully Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcfe5da-d68b-4691-bdfa-e0c893123fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (b7dc40ed-465a-4683-881e-0914a18a74fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-75897a2d-4639-4c5a-b9df-44b202cbf110 tempest-AttachVolumeNegativeTest-845487143 None] Created volume successfully. Sep 01 02:05:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4603519a-9f87-4d3c-9c23-ec56d194801c req-8ff61f64-a1b8-44d2-8aad-8d8409faaf5c tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4603519a-9f87-4d3c-9c23-ec56d194801c req-8ff61f64-a1b8-44d2-8aad-8d8409faaf5c tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4603519a-9f87-4d3c-9c23-ec56d194801c req-8ff61f64-a1b8-44d2-8aad-8d8409faaf5c tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4603519a-9f87-4d3c-9c23-ec56d194801c req-8ff61f64-a1b8-44d2-8aad-8d8409faaf5c tempest-AttachVolumeNegativeTest-845487143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-9c913d12-ea43-4d14-b91d-94c785b52aaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc66c786-a2c3-4b4b-b779-f09462c38624', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-4603519a-9f87-4d3c-9c23-ec56d194801c req-8ff61f64-a1b8-44d2-8aad-8d8409faaf5c tempest-AttachVolumeNegativeTest-845487143 None] attachment_update completed successfully. Sep 01 02:05:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-51206362-2561-4aa8-891a-16b245f4ae1d req-7c8d49c6-44cb-454f-b442-f073b5e1076a tempest-AttachVolumeNegativeTest-845487143 None] Terminate volume connection completed successfully. Sep 01 02:05:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-51206362-2561-4aa8-891a-16b245f4ae1d req-7c8d49c6-44cb-454f-b442-f073b5e1076a tempest-AttachVolumeNegativeTest-845487143 None] Deleting attachment cc66c786-a2c3-4b4b-b779-f09462c38624. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "cinder-7dcc1beb-aa0b-4036-a203-548a018f0454-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "cinder-7dcc1beb-aa0b-4036-a203-548a018f0454-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "cinder-quobyte-7dcc1beb-aa0b-4036-a203-548a018f0454" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "cinder-quobyte-7dcc1beb-aa0b-4036-a203-548a018f0454" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb2b42-2922-432c-b2a3-c4c977893d6b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:29 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 Sep 01 02:05:29 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:30 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:30 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454 Sep 01 02:05:30 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:30 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7dcc1beb-aa0b-4036-a203-548a018f0454" returned: 0 in 0.274s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "cinder-quobyte-7dcc1beb-aa0b-4036-a203-548a018f0454" released by "delete_volume" :: held 0.727s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Created reservations ['60afe5ec-55fd-4b4d-83a3-5705e61fa27b', '25b0c353-1861-4266-8022-a8efd7d47cbd', '9f2ce07e-b5e8-491e-8de4-98f68209f4c1', '111caa93-f60b-41f5-95b9-501f5d9089ad'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:30 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:05:30 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:31 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.331s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Deleted volume successfully. Sep 01 02:05:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-da70337a-edba-4ad1-a3af-fa19f4829b18 tempest-TaggedAttachmentsTest-1493972653 None] Lock "cinder-7dcc1beb-aa0b-4036-a203-548a018f0454-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=47,cinder:UPDATE=52,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:40 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:05:40 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=51,cinder:UPDATE=51,cinder:DELETE=6,cinder:INSERT=9 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:41 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:05:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Acquiring lock "cinder-9fa89731-5e25-4f13-a44a-e51e0f48edb3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "cinder-9fa89731-5e25-4f13-a44a-e51e0f48edb3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Acquiring lock "cinder-quobyte-9fa89731-5e25-4f13-a44a-e51e0f48edb3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "cinder-quobyte-9fa89731-5e25-4f13-a44a-e51e0f48edb3" acquired by "delete_volume" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba34c92-fa13-4235-8821-4790ce642be4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 Sep 01 02:06:09 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3" returned: 0 in 0.620s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3 Sep 01 02:06:09 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9fa89731-5e25-4f13-a44a-e51e0f48edb3" returned: 0 in 0.660s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "cinder-quobyte-9fa89731-5e25-4f13-a44a-e51e0f48edb3" released by "delete_volume" :: held 1.377s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Created reservations ['06806830-c4d1-452b-aeeb-260dc0496417', 'c95956ca-dcb8-4d88-a050-cec3c5622a28', 'e7211f95-2085-48cf-b2f2-e98fd8d4e58e', 'b27ee173-3088-484d-99da-3267063ae344'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:10 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.347s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Deleted volume successfully. Sep 01 02:06:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a5f95fe6-b536-4f36-943d-543f00b926f0 tempest-AttachVolumeShelveTestJSON-670903292 None] Lock "cinder-9fa89731-5e25-4f13-a44a-e51e0f48edb3-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (f003efdc-daf5-44a9-b57f-e80b1316f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f809251d-c97c-4063-91f4-993fadd63924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f809251d-c97c-4063-91f4-993fadd63924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1254941318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:19Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0992db12-5785-4a9b-9883-3f80fa74a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0992db12-5785-4a9b-9883-3f80fa74a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5352ab5-9a6b-40f7-8922-395f913243b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5352ab5-9a6b-40f7-8922-395f913243b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8', 'volume_name': 'volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611f6b5-fe3b-4588-b0b4-0c232668fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611f6b5-fe3b-4588-b0b4-0c232668fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cfdc50-b92e-408c-a031-df4fecc69b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Volume de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8', 'volume_size': 1} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1254941318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b7b0ddb3645e8b76ac5a3d923a85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:19Z,use_quota=True,user_id='8323c8f3d9ee47919c90ddc6e853bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Creating volume de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:19 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 1073741824 Sep 01 02:06:19 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:19 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 1073741824" returned: 0 in 0.689s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 Sep 01 02:06:20 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cfdc50-b92e-408c-a031-df4fecc69b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f1005d-2cdd-4fbf-84e1-ced59e1e4bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Volume volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 (de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8): created successfully Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f1005d-2cdd-4fbf-84e1-ced59e1e4bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Flow 'volume_create_manager' (f003efdc-daf5-44a9-b57f-e80b1316f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-48a4dec7-9db6-427c-bb50-c703e8d956df tempest-AttachVolumeNegativeTest-845487143 None] Created volume successfully. Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Flow 'volume_create_manager' (16c856ab-ffd3-4193-a9fe-682e6cc5ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7615ad6c-60ea-460b-8ee6-1dfb0da7d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7615ad6c-60ea-460b-8ee6-1dfb0da7d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-967594167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503115-eabd-44d1-9619-f58acfb48ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3aa1fcf3b849d78669ccbf6574801a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:21Z,use_quota=True,user_id='66d4fd1894d7473980a510ca42a4d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cac6cf-7ffe-4a84-9f7f-e01e1616aab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cac6cf-7ffe-4a84-9f7f-e01e1616aab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff00f92-fc77-45cc-8f37-59e51f1c03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff00f92-fc77-45cc-8f37-59e51f1c03e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2503115-eabd-44d1-9619-f58acfb48ffb', 'volume_name': 'volume-f2503115-eabd-44d1-9619-f58acfb48ffb', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d72de-52a9-41d6-ba36-79b4709a55f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d72de-52a9-41d6-ba36-79b4709a55f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46375f12-08ef-431c-a051-05f5fb981e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Volume f2503115-eabd-44d1-9619-f58acfb48ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2503115-eabd-44d1-9619-f58acfb48ffb', 'volume_size': 1} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-967594167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503115-eabd-44d1-9619-f58acfb48ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3aa1fcf3b849d78669ccbf6574801a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:21Z,use_quota=True,user_id='66d4fd1894d7473980a510ca42a4d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Creating volume f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:21 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:21 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb 1073741824 Sep 01 02:06:21 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:22 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb 1073741824" returned: 0 in 0.757s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:22 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb Sep 01 02:06:22 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b09b6e5-9e70-4365-82da-a84a30b947b4 req-4d1e93b5-fa3c-4cb5-a7f1-c3d3ef51caf0 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:22 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb" returned: 0 in 0.492s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b09b6e5-9e70-4365-82da-a84a30b947b4 req-4d1e93b5-fa3c-4cb5-a7f1-c3d3ef51caf0 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.119s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46375f12-08ef-431c-a051-05f5fb981e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2503115-eabd-44d1-9619-f58acfb48ffb', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b2804-9e41-41f9-b3f9-d226e404c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b09b6e5-9e70-4365-82da-a84a30b947b4 req-4d1e93b5-fa3c-4cb5-a7f1-c3d3ef51caf0 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:22 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Volume volume-f2503115-eabd-44d1-9619-f58acfb48ffb (f2503115-eabd-44d1-9619-f58acfb48ffb): created successfully Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b2804-9e41-41f9-b3f9-d226e404c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Flow 'volume_create_manager' (16c856ab-ffd3-4193-a9fe-682e6cc5ee02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-4cf390a7-2736-4926-a074-7d2fda639587 req-c0cd4523-ab7f-4e45-a939-e6cd6d5bbe3f tempest-VolumesSnapshotsTestJSON-403667933 None] Created volume successfully. Sep 01 02:06:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-7b09b6e5-9e70-4365-82da-a84a30b947b4 req-4d1e93b5-fa3c-4cb5-a7f1-c3d3ef51caf0 tempest-AttachVolumeNegativeTest-845487143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0430a2cc-b688-4cce-b913-1a8f878cd6a0', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-7b09b6e5-9e70-4365-82da-a84a30b947b4 req-4d1e93b5-fa3c-4cb5-a7f1-c3d3ef51caf0 tempest-AttachVolumeNegativeTest-845487143 None] attachment_update completed successfully. Sep 01 02:06:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Creating offline snapshot 30b824a8-8f2d-4253-884e-1aca0ee9f260 of volume f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda1289-8925-4170-aa03-49ea13ff1e04]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb Sep 01 02:06:24 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 1G Sep 01 02:06:24 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 1G" returned: 0 in 0.463s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503115-eabd-44d1-9619-f58acfb48ffb -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503115-eabd-44d1-9619-f58acfb48ffb -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 Sep 01 02:06:24 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-e171a9fb-41d5-4502-a1ae-ee8cf62421a3 req-655eac5f-c6c0-4605-8f5b-355ad38e9b8b tempest-AttachVolumeNegativeTest-845487143 None] Terminate volume connection completed successfully. Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-e171a9fb-41d5-4502-a1ae-ee8cf62421a3 req-655eac5f-c6c0-4605-8f5b-355ad38e9b8b tempest-AttachVolumeNegativeTest-845487143 None] Deleting attachment 0430a2cc-b688-4cce-b913-1a8f878cd6a0. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:25 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503115-eabd-44d1-9619-f58acfb48ffb -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 is being set with open permissions: ugo+rw Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 Sep 01 02:06:25 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info Sep 01 02:06:25 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info is being set with open permissions: ugo+rw Sep 01 02:06:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info Sep 01 02:06:25 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.info" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-0974e735-81d5-4488-a48a-cc5cb9778926 req-6394f61c-a72b-4b11-9d82-22de0847805d tempest-VolumesSnapshotsTestJSON-403667933 None] Create snapshot completed successfully Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "cinder-30b824a8-8f2d-4253-884e-1aca0ee9f260-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-30b824a8-8f2d-4253-884e-1aca0ee9f260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "cinder-quobyte-30b824a8-8f2d-4253-884e-1aca0ee9f260" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-30b824a8-8f2d-4253-884e-1aca0ee9f260" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Deleting offline snapshot 30b824a8-8f2d-4253-884e-1aca0ee9f260 of volume f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] snapshot_file for this snap is: volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc503bab-fa16-4154-b61e-d33e93265329]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 Sep 01 02:06:26 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:27 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260" returned: 0 in 0.599s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2503115-eabd-44d1-9619-f58acfb48ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3d6a9a-a9ad-4d71-a5ad-75c91b0b3f06]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:27 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb Sep 01 02:06:27 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:27 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb" returned: 0 in 0.527s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:27 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 Sep 01 02:06:27 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260" returned: 0 in 0.434s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:28 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260 Sep 01 02:06:28 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb.30b824a8-8f2d-4253-884e-1aca0ee9f260" returned: 0 in 0.290s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-30b824a8-8f2d-4253-884e-1aca0ee9f260" released by "_delete_snapshot" :: held 2.026s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" released by "delete_snapshot" :: held 2.074s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.quota [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Created reservations ['5a1894bc-0091-4663-82ea-b3c14eaf0fb5', 'd299cfe5-4faa-452e-9ab5-19b3ec9f85ca', '5dfdf2a2-e876-4730-9501-4076e685a300', 'cadffd65-e310-452c-b5cc-8394efef5d1a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Delete snapshot completed successfully. Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-fb0ab47c-2b05-4dd6-831e-d4514a8b0283 req-b2f35d12-d33c-4492-9603-30ce0688eb30 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-30b824a8-8f2d-4253-884e-1aca0ee9f260-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "cinder-f2503115-eabd-44d1-9619-f58acfb48ffb-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-f2503115-eabd-44d1-9619-f58acfb48ffb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6067c2-e21a-4ee5-8c9d-caadf3a3ceef]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:29 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb Sep 01 02:06:29 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:29 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb" returned: 0 in 0.447s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:29 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb Sep 01 02:06:29 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:29 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2503115-eabd-44d1-9619-f58acfb48ffb" returned: 0 in 0.286s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-quobyte-f2503115-eabd-44d1-9619-f58acfb48ffb" released by "delete_volume" :: held 0.819s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:29 devstack cinder-volume[86925]: DEBUG cinder.quota [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Created reservations ['3f0cac2e-bc8b-4b0e-b300-126b5706db78', '20c13de7-142f-4407-b242-9ba70bbbb176', '68d19aa3-f259-4376-98b0-786257b67dd7', '45c1b9c6-8585-41d8-9471-878cac44cfea'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:30 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:30 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:30 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.manager [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Deleted volume successfully. Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf633722-041c-4f95-a0dc-f219cce5f2ee req-ad7de59f-0708-4241-8d66-bb547734c2c4 tempest-VolumesSnapshotsTestJSON-403667933 None] Lock "cinder-f2503115-eabd-44d1-9619-f58acfb48ffb-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Flow 'volume_create_manager' (435cd66d-93b5-4cf6-a7f4-804469de6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ea8df2-bed0-45de-bdcc-8761787a00d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ea8df2-bed0-45de-bdcc-8761787a00d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733100954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b69cc5-e543-4848-bfb6-9b074d622993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa91f29a42453fae8af1fe28ff90b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:30Z,use_quota=True,user_id='31841f477dee439a8e74f224b7a94af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c46490-8dc7-4c51-af8e-43ad540c0d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c46490-8dc7-4c51-af8e-43ad540c0d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258d3405-0415-4db4-91dd-ed7ed3ce6c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258d3405-0415-4db4-91dd-ed7ed3ce6c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b69cc5-e543-4848-bfb6-9b074d622993', 'volume_name': 'volume-45b69cc5-e543-4848-bfb6-9b074d622993', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f04a5a-eb84-4ed4-a7fd-39978dfdf35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f04a5a-eb84-4ed4-a7fd-39978dfdf35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e5040-4d45-4d51-96c4-83d297590b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Volume 45b69cc5-e543-4848-bfb6-9b074d622993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b69cc5-e543-4848-bfb6-9b074d622993', 'volume_size': 1} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733100954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b69cc5-e543-4848-bfb6-9b074d622993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa91f29a42453fae8af1fe28ff90b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:30Z,use_quota=True,user_id='31841f477dee439a8e74f224b7a94af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Creating volume 45b69cc5-e543-4848-bfb6-9b074d622993 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:30 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:30 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 1073741824 Sep 01 02:06:30 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-quobyte-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" acquired by "delete_volume" :: waited 0.039s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c90672-8b23-458f-8890-fce6cef11b8f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:30 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 Sep 01 02:06:30 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:31 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" returned: 0 in 0.462s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 1073741824" returned: 0 in 0.616s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8 Sep 01 02:06:31 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 Sep 01 02:06:31 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:31 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8" released by "delete_volume" :: held 0.903s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:31 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993" returned: 0 in 0.418s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e5040-4d45-4d51-96c4-83d297590b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b69cc5-e543-4848-bfb6-9b074d622993', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b0895a-df30-43d3-adbf-a2cf5619fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Created reservations ['df7a63e8-87a0-4b52-ac47-86a2dc986c02', 'f58f99ef-92ad-48af-9485-b98fd1148384', '8b802228-2737-4698-bbdf-b344cc1a427e', 'da4ff32b-51c3-4e56-a202-de7892936b48'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:31 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Volume volume-45b69cc5-e543-4848-bfb6-9b074d622993 (45b69cc5-e543-4848-bfb6-9b074d622993): created successfully Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b0895a-df30-43d3-adbf-a2cf5619fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Flow 'volume_create_manager' (435cd66d-93b5-4cf6-a7f4-804469de6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2799a603-74c6-4911-bc71-deaa89536ced tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Created volume successfully. Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:32 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:32 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:32 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.295s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:32 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Deleted volume successfully. Sep 01 02:06:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f0995a9-7b9d-4795-ae44-c5182952978d tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-de4bb7d9-d29c-4c9d-aaf9-4fb445aaf6a8-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-9c913d12-ea43-4d14-b91d-94c785b52aaf-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-9c913d12-ea43-4d14-b91d-94c785b52aaf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-quobyte-9c913d12-ea43-4d14-b91d-94c785b52aaf" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-9c913d12-ea43-4d14-b91d-94c785b52aaf" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc82a05-e3b7-4c31-9910-f0c754911508]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf Sep 01 02:06:33 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-1642ac71-0d09-4712-bff2-f636a9d68be2 req-76c94fdd-d70c-4a9e-aa96-a137c5cea208 tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-1642ac71-0d09-4712-bff2-f636a9d68be2 req-76c94fdd-d70c-4a9e-aa96-a137c5cea208 tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-1642ac71-0d09-4712-bff2-f636a9d68be2 req-76c94fdd-d70c-4a9e-aa96-a137c5cea208 tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-1642ac71-0d09-4712-bff2-f636a9d68be2 req-76c94fdd-d70c-4a9e-aa96-a137c5cea208 tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-45b69cc5-e543-4848-bfb6-9b074d622993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cc88725-90e9-4540-96a2-085c5246c914', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-1642ac71-0d09-4712-bff2-f636a9d68be2 req-76c94fdd-d70c-4a9e-aa96-a137c5cea208 tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] attachment_update completed successfully. Sep 01 02:06:33 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf" returned: 0 in 0.418s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf Sep 01 02:06:33 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9c913d12-ea43-4d14-b91d-94c785b52aaf" returned: 0 in 0.321s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-9c913d12-ea43-4d14-b91d-94c785b52aaf" released by "delete_volume" :: held 0.794s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Created reservations ['73ef7bd7-869c-41db-9687-fd5f89512153', 'b5857562-622a-40d6-a5cf-552a3c74957a', '09e8f8ca-72a1-4441-9ab5-c3ef0946d93a', '70ce5b2f-4bbd-4621-bc6b-ef3425fea62d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:34 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Deleted volume successfully. Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ac46aea-5d49-41a0-bd03-e7170c8350fb tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-9c913d12-ea43-4d14-b91d-94c785b52aaf-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-a6fb8392-bb76-4289-81dc-2bc43ced503c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-a6fb8392-bb76-4289-81dc-2bc43ced503c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "cinder-quobyte-a6fb8392-bb76-4289-81dc-2bc43ced503c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-a6fb8392-bb76-4289-81dc-2bc43ced503c" acquired by "delete_volume" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dea464-aa10-4cd7-b853-8ae9f2cf9c16]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c Sep 01 02:06:34 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c" returned: 0 in 0.424s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c Sep 01 02:06:35 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6fb8392-bb76-4289-81dc-2bc43ced503c" returned: 0 in 0.295s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Flow 'volume_create_manager' (4eedd1c5-1c74-4233-b3f1-b40ff1eb2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b00b123-977c-4079-a2c4-7514d91ff01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-quobyte-a6fb8392-bb76-4289-81dc-2bc43ced503c" released by "delete_volume" :: held 0.825s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b00b123-977c-4079-a2c4-7514d91ff01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-177790540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dceb38-3ffe-42d0-86f7-0e895aa589dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c834141816f7455da71acb4bcf94ad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:35Z,use_quota=True,user_id='041e73014df14ba98ee3843b5de9a540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28f690d-03fd-4822-bf45-6b0d82b1c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28f690d-03fd-4822-bf45-6b0d82b1c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971d738c-3329-49ce-903c-9393988aedce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971d738c-3329-49ce-903c-9393988aedce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dceb38-3ffe-42d0-86f7-0e895aa589dc', 'volume_name': 'volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ab3138-57de-4791-8ee0-32e408f9e6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ab3138-57de-4791-8ee0-32e408f9e6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5895e-9335-4109-8e6a-813e1c8002f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:35 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Volume 59dceb38-3ffe-42d0-86f7-0e895aa589dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc', 'volume_size': 1} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-177790540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dceb38-3ffe-42d0-86f7-0e895aa589dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c834141816f7455da71acb4bcf94ad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:35Z,use_quota=True,user_id='041e73014df14ba98ee3843b5de9a540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Creating volume 59dceb38-3ffe-42d0-86f7-0e895aa589dc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:35 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc 1073741824 Sep 01 02:06:35 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Created reservations ['d49de984-4ea9-4389-ac6d-53886dd815bb', '7009a3c6-1f1b-4b59-a92c-ae948587f32c', '40d08f16-4448-4204-8416-a80647617824', '69864571-8469-43c7-82a5-28237d1af9bb'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:35 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:36 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.306s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Deleted volume successfully. Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8a0f45b5-2260-42bd-a701-e898c0dd2040 tempest-AttachVolumeNegativeTest-845487143 None] Lock "cinder-a6fb8392-bb76-4289-81dc-2bc43ced503c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:36 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc 1073741824" returned: 0 in 0.582s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc Sep 01 02:06:36 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:36 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc" returned: 0 in 0.265s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5895e-9335-4109-8e6a-813e1c8002f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba49673-fb4a-4e08-9c4e-f29577766721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Volume volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc (59dceb38-3ffe-42d0-86f7-0e895aa589dc): created successfully Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba49673-fb4a-4e08-9c4e-f29577766721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Flow 'volume_create_manager' (4eedd1c5-1c74-4233-b3f1-b40ff1eb2c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ac639d02-95dd-411b-b9fa-a27ba2611bb0 req-a94620f4-cd93-490d-87cc-b2b9b38c0a30 tempest-VolumesGetTestJSON-1254461137 None] Created volume successfully. Sep 01 02:06:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-e8251f38-6e73-411e-8faa-ca96c16d970c req-620ab7f6-278b-482c-b634-880ed79a8bcb tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Terminate volume connection completed successfully. Sep 01 02:06:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-e8251f38-6e73-411e-8faa-ca96c16d970c req-620ab7f6-278b-482c-b634-880ed79a8bcb tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Deleting attachment 2cc88725-90e9-4540-96a2-085c5246c914. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Acquiring lock "cinder-59dceb38-3ffe-42d0-86f7-0e895aa589dc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "cinder-59dceb38-3ffe-42d0-86f7-0e895aa589dc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Acquiring lock "cinder-quobyte-59dceb38-3ffe-42d0-86f7-0e895aa589dc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "cinder-quobyte-59dceb38-3ffe-42d0-86f7-0e895aa589dc" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac73a1-b63b-4ed2-8292-1e552b0dc826]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "cinder-45b69cc5-e543-4848-bfb6-9b074d622993-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "cinder-45b69cc5-e543-4848-bfb6-9b074d622993-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:38 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc Sep 01 02:06:38 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "cinder-quobyte-45b69cc5-e543-4848-bfb6-9b074d622993" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "cinder-quobyte-45b69cc5-e543-4848-bfb6-9b074d622993" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1688dad-0f3a-481f-99e1-65155b1f5dfd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 Sep 01 02:06:38 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc" returned: 0 in 0.468s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc Sep 01 02:06:38 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993" returned: 0 in 0.489s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993 Sep 01 02:06:38 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-59dceb38-3ffe-42d0-86f7-0e895aa589dc" returned: 0 in 0.328s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "cinder-quobyte-59dceb38-3ffe-42d0-86f7-0e895aa589dc" released by "delete_volume" :: held 0.856s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.quota [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Created reservations ['b833874d-cb0e-4e08-8949-37ad63d69c73', '1ba7d12c-c6ba-4eb0-b07f-4f728f7cb649', 'fb6a8e60-aed0-49c8-a7e9-ed60971fab15', '9d2a81de-50e1-4666-8bed-4fac3b3ab03c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:39 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:39 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-45b69cc5-e543-4848-bfb6-9b074d622993" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "cinder-quobyte-45b69cc5-e543-4848-bfb6-9b074d622993" released by "delete_volume" :: held 0.841s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Created reservations ['25c77aef-c461-40a0-9126-af7ed2afb202', '045d56ff-35d8-407a-988b-47e1cd409855', 'ff6ee83b-4466-4bda-90dc-3895b46d261a', '2ffcdc5b-1b30-4d6c-a155-2137d20cb76a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:39 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:39 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:39 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.manager [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Deleted volume successfully. Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-bf36d7fc-8030-4337-930b-7cfecbb10121 req-25c3dea7-b324-474d-a467-78c6f84d2fd7 tempest-VolumesGetTestJSON-1254461137 None] Lock "cinder-59dceb38-3ffe-42d0-86f7-0e895aa589dc-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:39 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.298s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Deleted volume successfully. Sep 01 02:06:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bf28a96c-fb15-4a0f-b343-2c462749ecfc tempest-TestServerVolumeAttachScenarioOldVersion-866625556 None] Lock "cinder-45b69cc5-e543-4848-bfb6-9b074d622993-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:40 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:06:40 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:41 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.286s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:06:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Flow 'volume_create_manager' (764bd7aa-7eca-45f3-aa82-a4adc51161ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a465e90c-9c53-48af-b627-60a0ba33ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a465e90c-9c53-48af-b627-60a0ba33ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1472591474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14bfba7-09f4-4c59-b73d-cbca851aaad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e18f5cfe43c4eb4a311b46a82986172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:46Z,use_quota=True,user_id='61057d5f794e430ca8d2cb37ec1d72ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15f9d5-14fa-4825-b383-7b67623d9ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15f9d5-14fa-4825-b383-7b67623d9ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8872d4-d448-4cda-8570-cc4216dc56f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8872d4-d448-4cda-8570-cc4216dc56f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'volume_name': 'volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309a1ad0-514c-43eb-b37f-38c465be8384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309a1ad0-514c-43eb-b37f-38c465be8384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa846b8c-e209-4227-bb65-10553c1847ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Volume e14bfba7-09f4-4c59-b73d-cbca851aaad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'volume_size': 1} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1472591474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14bfba7-09f4-4c59-b73d-cbca851aaad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e18f5cfe43c4eb4a311b46a82986172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:46Z,use_quota=True,user_id='61057d5f794e430ca8d2cb37ec1d72ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Creating volume e14bfba7-09f4-4c59-b73d-cbca851aaad3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:46 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:46 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 1073741824 Sep 01 02:06:46 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:47 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 1073741824" returned: 0 in 0.562s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:47 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 Sep 01 02:06:47 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:47 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa846b8c-e209-4227-bb65-10553c1847ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ecf3db-4312-43f4-92ed-d083934eb2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:47 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Volume volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 (e14bfba7-09f4-4c59-b73d-cbca851aaad3): created successfully Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ecf3db-4312-43f4-92ed-d083934eb2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Flow 'volume_create_manager' (764bd7aa-7eca-45f3-aa82-a4adc51161ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b183ffaa-44fa-45b7-83ee-e66cd5a2e6f4 tempest-ServerActionsTestOtherA-1734043553 None] Created volume successfully. Sep 01 02:06:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aab35204-8055-4a00-a80f-0a5eba657bf4 tempest-GroupsV314Test-2120257329 None] Group tempest-GroupsV314Test-Group-754770485: creating Sep 01 02:06:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aab35204-8055-4a00-a80f-0a5eba657bf4 tempest-GroupsV314Test-2120257329 None] Group tempest-GroupsV314Test-Group-754770485: created successfully Sep 01 02:06:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aab35204-8055-4a00-a80f-0a5eba657bf4 tempest-GroupsV314Test-2120257329 None] Create group completed successfully. Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Flow 'volume_create_manager' (d92618cd-98fb-4156-95d2-469cbac6ca75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ce22f-580e-44e4-b6e0-9266ed71e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ce22f-580e-44e4-b6e0-9266ed71e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002829294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=054c63a3-1a60-4969-87ba-fd16d66e3468,host='devstack@QuobyteHD#QuobyteHD',id=d923bb2e-404b-4344-8cde-21cdef4ae754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c169cd7af7e478c87e714bed1a6ccc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:54Z,use_quota=True,user_id='3be5755333c540e188c4b16215f75b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3376a5ee-4626-4396-ac99-dc25ed241047),volume_type_id=3376a5ee-4626-4396-ac99-dc25ed241047)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56922ebe-3344-4e0f-aa42-8b34338b3f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56922ebe-3344-4e0f-aa42-8b34338b3f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8849c9d-1faa-47e0-a560-db7149459ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8849c9d-1faa-47e0-a560-db7149459ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd923bb2e-404b-4344-8cde-21cdef4ae754', 'volume_name': 'volume-d923bb2e-404b-4344-8cde-21cdef4ae754', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954115f1-4567-46ec-9490-b53dcdecd71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954115f1-4567-46ec-9490-b53dcdecd71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a81ac-253c-481a-aa8c-3f5d5a3a2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Volume d923bb2e-404b-4344-8cde-21cdef4ae754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d923bb2e-404b-4344-8cde-21cdef4ae754', 'volume_size': 1} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=054c63a3-1a60-4969-87ba-fd16d66e3468,created_at=2026-09-01T00:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002829294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=054c63a3-1a60-4969-87ba-fd16d66e3468,host='devstack@QuobyteHD#QuobyteHD',id=d923bb2e-404b-4344-8cde-21cdef4ae754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c169cd7af7e478c87e714bed1a6ccc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:54Z,use_quota=True,user_id='3be5755333c540e188c4b16215f75b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3376a5ee-4626-4396-ac99-dc25ed241047),volume_type_id=3376a5ee-4626-4396-ac99-dc25ed241047)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Creating volume d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:53 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:06:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:53 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 1073741824 Sep 01 02:06:53 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:54 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 1073741824" returned: 0 in 0.723s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:54 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:06:54 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.447s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a81ac-253c-481a-aa8c-3f5d5a3a2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d923bb2e-404b-4344-8cde-21cdef4ae754', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d02f78-4fdd-4b9e-919b-1851cda10f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Volume volume-d923bb2e-404b-4344-8cde-21cdef4ae754 (d923bb2e-404b-4344-8cde-21cdef4ae754): created successfully Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d02f78-4fdd-4b9e-919b-1851cda10f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Flow 'volume_create_manager' (d92618cd-98fb-4156-95d2-469cbac6ca75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-61a1a896-0534-4700-a070-2a579c8c2ebf tempest-GroupsV314Test-2120257329 None] Created volume successfully. Sep 01 02:06:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:57 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Cloning volume d923bb2e-404b-4344-8cde-21cdef4ae754 to volume e4b09488-8d89-48bf-9e21-5d6f36a23b88 Sep 01 02:06:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Creating offline snapshot af10dccb-d380-4dfc-9291-2846b64a7eaa of volume d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:57 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[260bff19-2ea7-415b-ae5a-4e6885b0cf93]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:06:57 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.637s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa 1G Sep 01 02:06:58 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa 1G" returned: 0 in 0.489s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d923bb2e-404b-4344-8cde-21cdef4ae754 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d923bb2e-404b-4344-8cde-21cdef4ae754 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:06:58 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d923bb2e-404b-4344-8cde-21cdef4ae754 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.431s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:06:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:06:59 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.356s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info Sep 01 02:06:59 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info" returned: 0 in 0.649s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info Sep 01 02:07:00 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.info" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Acquiring lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] snapshot: af10dccb-d380-4dfc-9291-2846b64a7eaa, volume: e4b09488-8d89-48bf-9e21-5d6f36a23b88, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[982a890e-1035-43a0-bf5a-73cf40e802a4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:07:00 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:01 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.669s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d923bb2e-404b-4344-8cde-21cdef4ae754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c894f-67c7-4ba2-b127-f2f24ca998b0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:07:01 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.855s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:07:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:07:02 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:07:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 Sep 01 02:07:02 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:09 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88" returned: 0 in 7.109s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:09 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Converted 1024.00 MB image at 144.02 MB/s Sep 01 02:07:09 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:09 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 Sep 01 02:07:09 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=85,cinder:SELECT=84,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=11 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:09 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88" returned: 0 in 0.513s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" released by "_copy_volume_from_snapshot" :: held 9.287s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Acquiring lock "cinder-quobyte-af10dccb-d380-4dfc-9291-2846b64a7eaa" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-af10dccb-d380-4dfc-9291-2846b64a7eaa" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Deleting offline snapshot af10dccb-d380-4dfc-9291-2846b64a7eaa of volume d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] snapshot_file for this snap is: volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd144ca3-06c8-4e24-92a1-055449e9cbf7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:10 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:07:10 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:10 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.541s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d923bb2e-404b-4344-8cde-21cdef4ae754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:10 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a1ea3a-16e7-4bc2-9605-49cab8395d7b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:10 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:07:10 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.821s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:11 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:07:11 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.477s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:11 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa Sep 01 02:07:11 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754.af10dccb-d380-4dfc-9291-2846b64a7eaa" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-af10dccb-d380-4dfc-9291-2846b64a7eaa" released by "_delete_snapshot" :: held 2.293s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.803s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5572ec5f-c5d6-464a-a02f-df7d39cdeca2 tempest-GroupsV314Test-2120257329 None] Create group from source-group-054c63a3-1a60-4969-87ba-fd16d66e3468 completed successfully. Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Acquiring lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d953285d-6146-44b0-b119-92c157885660]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 Sep 01 02:07:14 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88" returned: 0 in 0.609s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88 Sep 01 02:07:14 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:15 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e4b09488-8d89-48bf-9e21-5d6f36a23b88" returned: 0 in 0.290s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-e4b09488-8d89-48bf-9e21-5d6f36a23b88" released by "delete_volume" :: held 0.966s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Created reservations ['8540e08e-9195-4a2e-883a-0c3151fe5411'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:15 devstack cinder-volume[86925]: WARNING cinder.quota [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1779735885 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1779735885, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:15 devstack cinder-volume[86925]: WARNING cinder.quota [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1779735885 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1779735885, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Created reservations ['987eada3-3551-42e5-b362-984ea607be9c', '5405f435-e40f-4f2c-ad4c-2225b0b5b486', 'ced92e26-ba8d-4b7c-9798-75bdbcb91ed0', '1a5dc420-dea2-4ddf-8d5d-63c12ce8e3b3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:15 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:07:15 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:15 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.382s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:15 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-278425e2-7455-46d1-b12c-16959f205d28 tempest-GroupsV314Test-2120257329 None] Delete group completed successfully. Sep 01 02:07:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Acquiring lock "cinder-quobyte-d923bb2e-404b-4344-8cde-21cdef4ae754" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-d923bb2e-404b-4344-8cde-21cdef4ae754" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a0211-9850-4185-8a7c-7230ff14c32a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:07:17 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.460s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754 Sep 01 02:07:17 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d923bb2e-404b-4344-8cde-21cdef4ae754" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Lock "cinder-quobyte-d923bb2e-404b-4344-8cde-21cdef4ae754" released by "delete_volume" :: held 0.814s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Created reservations ['8becb57e-841c-4295-9d62-099b66b77175'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:17 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Created reservations ['e3957728-0684-4252-b597-2c4b84420930', '9eca1d13-f39f-4190-bf6a-befa8b033d0b', 'b4b5d1b8-6f57-4ef7-af01-723778bec36e', 'c466b4b5-3401-4bf3-9ff2-49aeeb8a622f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:07:18 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.315s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9f062408-a766-4d88-b97c-3a4dfca7626a tempest-GroupsV314Test-2120257329 None] Delete group completed successfully. Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Flow 'volume_create_manager' (08ca7883-2e1b-4051-9c91-b795a21c1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1e6d5a-bcc5-491e-b423-899afe52921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1e6d5a-bcc5-491e-b423-899afe52921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-292120237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e271623b-9cad-4e6e-9900-2ffc73622be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5797613b434041da923a6e441e9346e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:19Z,use_quota=True,user_id='3d8344f043194fbe8f072beaac067db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90435daa-c84f-4efb-a4e2-f760dca7eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90435daa-c84f-4efb-a4e2-f760dca7eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9717be24-4978-4a8b-8325-4a1b41f4f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9717be24-4978-4a8b-8325-4a1b41f4f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e271623b-9cad-4e6e-9900-2ffc73622be9', 'volume_name': 'volume-e271623b-9cad-4e6e-9900-2ffc73622be9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e8114b-1f77-48eb-a00b-ec0ed24bc937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e8114b-1f77-48eb-a00b-ec0ed24bc937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282feb42-716a-4208-ac0b-c987fabf9d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Volume e271623b-9cad-4e6e-9900-2ffc73622be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e271623b-9cad-4e6e-9900-2ffc73622be9', 'volume_size': 1} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-292120237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e271623b-9cad-4e6e-9900-2ffc73622be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5797613b434041da923a6e441e9346e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:19Z,use_quota=True,user_id='3d8344f043194fbe8f072beaac067db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Creating volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:19 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 1073741824 Sep 01 02:07:19 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:19 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 1073741824" returned: 0 in 0.586s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:19 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 Sep 01 02:07:19 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:20 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282feb42-716a-4208-ac0b-c987fabf9d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e271623b-9cad-4e6e-9900-2ffc73622be9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f1875c-e8cc-4453-8df1-50ffa41eaba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Volume volume-e271623b-9cad-4e6e-9900-2ffc73622be9 (e271623b-9cad-4e6e-9900-2ffc73622be9): created successfully Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f1875c-e8cc-4453-8df1-50ffa41eaba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Flow 'volume_create_manager' (08ca7883-2e1b-4051-9c91-b795a21c1f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-68059039-58b0-44e6-ba84-d4f73e328aa4 tempest-SnapshotsActionsTest-1470452869 None] Created volume successfully. Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Creating offline snapshot cc6e1362-cd31-445c-89cd-cb6fd705d2ff of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1316b38-523b-4c86-8188-0e02cb849957]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 Sep 01 02:07:21 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9" returned: 0 in 0.497s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff 1G Sep 01 02:07:21 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:22 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff 1G" returned: 0 in 0.526s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:22 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:22 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:22 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:22 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff is being set with open permissions: ugo+rw Sep 01 02:07:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:22 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:22 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:23 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.403s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:23 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info Sep 01 02:07:23 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:23 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:23 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info is being set with open permissions: ugo+rw Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:23 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info Sep 01 02:07:23 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:23 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.info" returned: 0 in 0.311s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3749d0e3-8644-4a6e-965d-5ee45d8bbfc0 tempest-SnapshotsActionsTest-1470452869 None] Create snapshot completed successfully Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Creating offline snapshot 257b4249-951f-496c-a0dd-928c5582f631 of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b2d629-f664-4bdf-a129-4c428a997dd3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4fdaec56-c2aa-4606-8990-332465878c93 tempest-GroupsV320Test-922169361 None] Group tempest-GroupsV320Test-Group-616181992: creating Sep 01 02:07:25 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:25 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4fdaec56-c2aa-4606-8990-332465878c93 tempest-GroupsV320Test-922169361 None] Group tempest-GroupsV320Test-Group-616181992: created successfully Sep 01 02:07:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4fdaec56-c2aa-4606-8990-332465878c93 tempest-GroupsV320Test-922169361 None] Create group completed successfully. Sep 01 02:07:25 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:25 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 1G Sep 01 02:07:25 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:26 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 1G" returned: 0 in 0.465s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:26 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 Sep 01 02:07:26 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:26 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631" returned: 0 in 0.356s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:26 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 is being set with open permissions: ugo+rw Sep 01 02:07:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:26 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 Sep 01 02:07:26 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.698s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2825b0ca-4da6-4da6-92cb-497cb90bba13 tempest-SnapshotsActionsTest-1470452869 None] Create snapshot completed successfully Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Created reservations ['c8aa061d-178f-4a32-a318-ac5105425336'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:07:27 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9e1894e8-96d0-45d2-ab61-b0768f975527 tempest-GroupsV320Test-922169361 None] Delete group completed successfully. Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-257b4249-951f-496c-a0dd-928c5582f631-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-257b4249-951f-496c-a0dd-928c5582f631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-257b4249-951f-496c-a0dd-928c5582f631" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-257b4249-951f-496c-a0dd-928c5582f631" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Deleting offline snapshot 257b4249-951f-496c-a0dd-928c5582f631 of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] snapshot_file for this snap is: volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355e54d-8fb9-4dfd-b53e-e4d9e16f8ce2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 Sep 01 02:07:27 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[10144d2f-156f-45f0-8593-1a868a59a61d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:28 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.440s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 Sep 01 02:07:28 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631" returned: 0 in 0.500s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631 Sep 01 02:07:29 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.257b4249-951f-496c-a0dd-928c5582f631" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-257b4249-951f-496c-a0dd-928c5582f631" released by "_delete_snapshot" :: held 1.735s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_snapshot" :: held 1.762s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Created reservations ['ee5686f4-2a79-42e5-a82b-60059d006baa', '491d3e4c-3499-4943-9174-9d916a0e0cdd', 'fd9ce4d4-3fb7-498e-af94-ffb677539618', 'a1de3958-1eac-426b-93c9-c0a1b56d16f3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Delete snapshot completed successfully. Sep 01 02:07:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d006161c-a77f-4469-9fc2-8cd04099a78f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-257b4249-951f-496c-a0dd-928c5582f631-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Creating offline snapshot edf0247b-a518-4ad2-8b0d-131d735f36ff of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e53ddef-10de-4db0-9c47-910855cb7b04]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:30 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:30 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.541s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff 1G Sep 01 02:07:30 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ece00a91-dac3-4342-a62d-dcbd00a4792e req-63829544-77f9-4c2c-8f93-3b5d6d7f0f69 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:31 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff 1G" returned: 0 in 0.685s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:31 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff Sep 01 02:07:31 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff is being set with open permissions: ugo+rw Sep 01 02:07:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:32 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff Sep 01 02:07:32 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:32 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff" returned: 0 in 0.331s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ece00a91-dac3-4342-a62d-dcbd00a4792e req-63829544-77f9-4c2c-8f93-3b5d6d7f0f69 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.949s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ece00a91-dac3-4342-a62d-dcbd00a4792e req-63829544-77f9-4c2c-8f93-3b5d6d7f0f69 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eb2c1d17-7720-4491-bfad-3f8a9fe5e8df tempest-SnapshotsActionsTest-1470452869 None] Create snapshot completed successfully Sep 01 02:07:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ece00a91-dac3-4342-a62d-dcbd00a4792e req-63829544-77f9-4c2c-8f93-3b5d6d7f0f69 tempest-ServerActionsTestOtherA-1734043553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fa1caae-14a2-44be-ac61-8cc044a548ae', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ece00a91-dac3-4342-a62d-dcbd00a4792e req-63829544-77f9-4c2c-8f93-3b5d6d7f0f69 tempest-ServerActionsTestOtherA-1734043553 None] attachment_update completed successfully. Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-edf0247b-a518-4ad2-8b0d-131d735f36ff-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-edf0247b-a518-4ad2-8b0d-131d735f36ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-edf0247b-a518-4ad2-8b0d-131d735f36ff" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-edf0247b-a518-4ad2-8b0d-131d735f36ff" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Deleting offline snapshot edf0247b-a518-4ad2-8b0d-131d735f36ff of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] snapshot_file for this snap is: volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc6d38-cfe5-4632-972c-08912b0f4cf6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff Sep 01 02:07:33 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff" returned: 0 in 0.426s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f9f7b9-3bb2-4f11-8e93-64c3f3829c83]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:34 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:34 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.438s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:34 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff Sep 01 02:07:34 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff" returned: 0 in 0.505s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff Sep 01 02:07:35 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.edf0247b-a518-4ad2-8b0d-131d735f36ff" returned: 0 in 0.359s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-edf0247b-a518-4ad2-8b0d-131d735f36ff" released by "_delete_snapshot" :: held 1.880s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_snapshot" :: held 1.933s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Created reservations ['b0690ba0-6857-4bc6-9e30-b10e5af13f6f', 'fb63b9ad-9d7d-491b-9acb-dc7d5e3bace1', '8ccb1508-6fc5-4243-895f-084600e3acde', 'b2b42ea7-abbe-4e07-b713-eee44ba9b74e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Delete snapshot completed successfully. Sep 01 02:07:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0dc08d91-b1e6-4086-b144-a71cee21bc6f tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-edf0247b-a518-4ad2-8b0d-131d735f36ff-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-b17b71f5-0905-4419-9b58-57b1584035ef tempest-ServerActionsTestOtherA-1734043553 None] Terminate volume connection completed successfully. Sep 01 02:07:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-b17b71f5-0905-4419-9b58-57b1584035ef tempest-ServerActionsTestOtherA-1734043553 None] Deleting attachment 5fa1caae-14a2-44be-ac61-8cc044a548ae. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Creating offline snapshot 08a23ccb-963a-4641-9fb8-d9ca5a34a44c of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1e760-1836-4b02-b8cc-90541985841e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:37 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:37 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-7926b0c8-6a48-4578-9cdb-05fab1c71c26 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:38 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.660s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:38 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c 1G Sep 01 02:07:38 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:38 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c 1G" returned: 0 in 0.607s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:39 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c Sep 01 02:07:39 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:39 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:39 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c is being set with open permissions: ugo+rw Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:39 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c Sep 01 02:07:39 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:39 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c" returned: 0 in 0.323s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-7926b0c8-6a48-4578-9cdb-05fab1c71c26 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.800s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-7926b0c8-6a48-4578-9cdb-05fab1c71c26 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a385fd47-8465-46a5-a320-de07ef9b54cf tempest-SnapshotsActionsTest-1470452869 None] Create snapshot completed successfully Sep 01 02:07:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-7926b0c8-6a48-4578-9cdb-05fab1c71c26 tempest-ServerActionsTestOtherA-1734043553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35eead3d-9bef-4761-b347-e63d986bb3c1', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-f3bf087b-b3e6-481d-acd9-188861ace87d req-7926b0c8-6a48-4578-9cdb-05fab1c71c26 tempest-ServerActionsTestOtherA-1734043553 None] attachment_update completed successfully. Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:40 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:07:40 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-08a23ccb-963a-4641-9fb8-d9ca5a34a44c-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-08a23ccb-963a-4641-9fb8-d9ca5a34a44c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-08a23ccb-963a-4641-9fb8-d9ca5a34a44c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-08a23ccb-963a-4641-9fb8-d9ca5a34a44c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Deleting offline snapshot 08a23ccb-963a-4641-9fb8-d9ca5a34a44c of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:41 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] snapshot_file for this snap is: volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435a7ff-4836-4cb9-a191-5dbf2d4e48b8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:41 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c Sep 01 02:07:41 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:41 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c" returned: 0 in 0.526s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c9b56-748e-44d0-adb2-e0a889260a33]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:42 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:42 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:42 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.747s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:42 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c Sep 01 02:07:42 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:43 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c" returned: 0 in 0.742s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:43 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c Sep 01 02:07:43 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:43 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.08a23ccb-963a-4641-9fb8-d9ca5a34a44c" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-08a23ccb-963a-4641-9fb8-d9ca5a34a44c" released by "_delete_snapshot" :: held 2.640s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_snapshot" :: held 2.678s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Created reservations ['6de21ca2-855e-49ef-985b-ca79ff121159', 'b65637e1-2880-49bc-9b47-a25e02b9c91d', 'e819bcf7-86f2-44bc-a6d7-0af618efd047', '97dc31d5-4718-4617-ab1b-b948331c4ba9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Delete snapshot completed successfully. Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-37c5aecc-fb18-4e4d-a7f4-d1fa23d8a79c tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-08a23ccb-963a-4641-9fb8-d9ca5a34a44c-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Flow 'volume_create_manager' (49138a73-3560-4e11-91e7-2657536533d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bf8cbd-3d63-4e79-8328-6fd9741bc0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bf8cbd-3d63-4e79-8328-6fd9741bc0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1870713399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6155bcf-c0ac-4275-9e5b-6289b4061483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a92daca800b4c8c9a2a0c35b5be5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:44Z,use_quota=True,user_id='e3045053a1434d3a9afbc75a27520548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafccbfb-4faf-4e74-ad60-100b3c6cdab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafccbfb-4faf-4e74-ad60-100b3c6cdab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68338b0d-7ff4-4679-bd9f-bbf9fae7faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:44 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Creating offline snapshot b9860b57-f471-4cdd-96cf-8ba91ea9030d of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c2fe4-22aa-4cda-acd9-0b32ba1df1d3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68338b0d-7ff4-4679-bd9f-bbf9fae7faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6155bcf-c0ac-4275-9e5b-6289b4061483', 'volume_name': 'volume-a6155bcf-c0ac-4275-9e5b-6289b4061483', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a22f015-37cd-4806-9bba-510bde64137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a22f015-37cd-4806-9bba-510bde64137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df5d894-32b4-430f-970d-d941ec05009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:45 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Volume a6155bcf-c0ac-4275-9e5b-6289b4061483: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6155bcf-c0ac-4275-9e5b-6289b4061483', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:07:45 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Trying to clone a6155bcf-c0ac-4275-9e5b-6289b4061483 from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:07:45 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:45 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:07:46 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:07:46 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.807s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d 1G Sep 01 02:07:46 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[42beee17-0c80-4648-af11-c372958cfeb4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD Sep 01 02:07:46 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 is fetched for user e3045053a1434d3a9afbc75a27520548. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5bfaf-0dd6-4dac-b34c-0b9f9941d44e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d 1G" returned: 0 in 0.793s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d Sep 01 02:07:46 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD Sep 01 02:07:46 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:47 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d" returned: 0 in 0.425s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d is being set with open permissions: ugo+rw Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:47 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d Sep 01 02:07:47 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1870713399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6155bcf-c0ac-4275-9e5b-6289b4061483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a92daca800b4c8c9a2a0c35b5be5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:44Z,use_quota=True,user_id='e3045053a1434d3a9afbc75a27520548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Creating volume a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:47 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:07:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:47 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1073741824 Sep 01 02:07:47 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-08bad482-7de7-488d-818c-624b74a29423 tempest-SnapshotsActionsTest-1470452869 None] Create snapshot completed successfully Sep 01 02:07:48 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1073741824" returned: 0 in 0.503s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 Sep 01 02:07:48 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-b9860b57-f471-4cdd-96cf-8ba91ea9030d-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-b9860b57-f471-4cdd-96cf-8ba91ea9030d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Acquiring lock "cinder-quobyte-b9860b57-f471-4cdd-96cf-8ba91ea9030d" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-b9860b57-f471-4cdd-96cf-8ba91ea9030d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Deleting offline snapshot b9860b57-f471-4cdd-96cf-8ba91ea9030d of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:48 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] snapshot_file for this snap is: volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483" returned: 0 in 0.336s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c83fa-adf3-4d0b-85f9-f31849f43496]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Attempting download of 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume a6155bcf-c0ac-4275-9e5b-6289b4061483. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a56ce0-66e9-4f04-b717-656ffa160751]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d Sep 01 02:07:48 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr Sep 01 02:07:48 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d" returned: 0 in 0.454s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e74364-eb2d-42f8-b540-1f3bd7ae04d6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:49 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr Sep 01 02:07:49 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr" returned: 1 in 0.386s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kve4h4tr' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c0625-7f5e-4168-b3f2-2bf7ac043b54]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.463s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d Sep 01 02:07:49 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD Sep 01 02:07:49 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] 514cc436-eb47-42bc-a3be-d669f2c6dfb1 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 Sep 01 02:07:49 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d" returned: 0 in 0.542s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d Sep 01 02:07:50 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.b9860b57-f471-4cdd-96cf-8ba91ea9030d" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-b9860b57-f471-4cdd-96cf-8ba91ea9030d" released by "_delete_snapshot" :: held 1.900s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_snapshot" :: held 1.934s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:50 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Created reservations ['f3506d4d-b05a-4802-8f9a-9a260c2987d8', '7615e3ac-eee7-4457-927c-901ee7cc1784', '9fd21f95-ba1f-4ed0-a97f-1f1e5f208cd0', 'a9ad1787-f0d0-40b5-82e9-5e40eba080a7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Delete snapshot completed successfully. Sep 01 02:07:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6cce5f4a-1f9f-438c-b3c5-f9169b1f7328 tempest-SnapshotsActionsTest-591214995 None] Lock "cinder-b9860b57-f471-4cdd-96cf-8ba91ea9030d-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "cinder-cc6e1362-cd31-445c-89cd-cb6fd705d2ff-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-cc6e1362-cd31-445c-89cd-cb6fd705d2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "cinder-quobyte-cc6e1362-cd31-445c-89cd-cb6fd705d2ff" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-cc6e1362-cd31-445c-89cd-cb6fd705d2ff" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Deleting offline snapshot cc6e1362-cd31-445c-89cd-cb6fd705d2ff of volume e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] snapshot_file for this snap is: volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[23120b59-c5a3-46d9-bcea-87e0918dd122]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:51 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.557s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e271623b-9cad-4e6e-9900-2ffc73622be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af77a5d-5e66-4d7d-b0be-98340826b8dd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 Sep 01 02:07:52 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483" returned: 0 in 2.556s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_6g_ax5q6devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:52 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Converted 112.00 MB image at 43.77 MB/s Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9" returned: 0 in 0.544s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1G Sep 01 02:07:52 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:52 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 1G" returned: 0 in 0.429s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Downloaded image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume a6155bcf-c0ac-4275-9e5b-6289b4061483 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 for user e3045053a1434d3a9afbc75a27520548 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Marking volume a6155bcf-c0ac-4275-9e5b-6289b4061483 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Copying metadata from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 to a6155bcf-c0ac-4275-9e5b-6289b4061483. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Creating volume glance metadata for volume a6155bcf-c0ac-4275-9e5b-6289b4061483 backed by image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:07:52 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.493s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:53 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff Sep 01 02:07:53 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df5d894-32b4-430f-970d-d941ec05009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6155bcf-c0ac-4275-9e5b-6289b4061483', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87521a5-1573-4fe6-9931-35239b73cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Volume volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 (a6155bcf-c0ac-4275-9e5b-6289b4061483): created successfully Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87521a5-1573-4fe6-9931-35239b73cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Flow 'volume_create_manager' (49138a73-3560-4e11-91e7-2657536533d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-345c471c-2679-4081-b500-1f00d6642553 tempest-TestShelveInstance-646908429 None] Created volume successfully. Sep 01 02:07:53 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9.cc6e1362-cd31-445c-89cd-cb6fd705d2ff" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-cc6e1362-cd31-445c-89cd-cb6fd705d2ff" released by "_delete_snapshot" :: held 2.108s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_snapshot" :: held 2.145s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Created reservations ['fa9a0303-5b0d-46e8-bc54-727fe1cff45a', 'bdfbe9e5-ee89-4e3c-a705-8c65d901a0fe', 'ecea039d-846e-4c4c-aace-fe82f6ddbd19', 'e40b6e94-f8c8-4336-b885-d9033b289929'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Delete snapshot completed successfully. Sep 01 02:07:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f9794a65-75a7-4fe0-bf61-fb8675e2fc62 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-cc6e1362-cd31-445c-89cd-cb6fd705d2ff-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "cinder-e271623b-9cad-4e6e-9900-2ffc73622be9-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-e271623b-9cad-4e6e-9900-2ffc73622be9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[93965be4-48e5-46ea-b679-a3a01b524eab]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:55 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 Sep 01 02:07:55 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:55 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9" returned: 0 in 0.556s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:55 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9 Sep 01 02:07:55 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:55 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e271623b-9cad-4e6e-9900-2ffc73622be9" returned: 0 in 0.358s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-quobyte-e271623b-9cad-4e6e-9900-2ffc73622be9" released by "delete_volume" :: held 1.007s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Created reservations ['81cca264-54ad-4b46-9497-65b4d0df8055', 'bd5c094a-97d8-4af0-8f12-9173cb5a4463', '6c6c2209-21ad-4eb0-93ca-d8289eb8467b', 'cd33ec69-7bc2-47a6-b9ed-df271da7ba32'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:56 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:07:56 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:56 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.375s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Deleted volume successfully. Sep 01 02:07:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cdab01c-ff88-4ba1-8e2e-622021ea5529 tempest-SnapshotsActionsTest-1470452869 None] Lock "cinder-e271623b-9cad-4e6e-9900-2ffc73622be9-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a939858a-050d-4950-a7b5-dc9a79dd47a9 req-023f8280-a7e0-4a10-8da9-2e8aaf1de7e9 tempest-TestShelveInstance-646908429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a939858a-050d-4950-a7b5-dc9a79dd47a9 req-023f8280-a7e0-4a10-8da9-2e8aaf1de7e9 tempest-TestShelveInstance-646908429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a939858a-050d-4950-a7b5-dc9a79dd47a9 req-023f8280-a7e0-4a10-8da9-2e8aaf1de7e9 tempest-TestShelveInstance-646908429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-a939858a-050d-4950-a7b5-dc9a79dd47a9 req-023f8280-a7e0-4a10-8da9-2e8aaf1de7e9 tempest-TestShelveInstance-646908429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-a6155bcf-c0ac-4275-9e5b-6289b4061483', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aac2a67-d551-4fc0-aea7-6ae1f7d41fc6', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-a939858a-050d-4950-a7b5-dc9a79dd47a9 req-023f8280-a7e0-4a10-8da9-2e8aaf1de7e9 tempest-TestShelveInstance-646908429 None] attachment_update completed successfully. Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (bfef365d-1939-4791-b0ea-5733fe0a916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e2208c-85c8-4fcf-8721-37de64ddea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e2208c-85c8-4fcf-8721-37de64ddea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-397062376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af35fd55-5fe2-48da-8334-3d715b66f449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:07Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced1fdb-0413-4a8b-91c5-f59c83a68dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced1fdb-0413-4a8b-91c5-f59c83a68dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f71a4c-329e-48af-89ad-766580e7f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f71a4c-329e-48af-89ad-766580e7f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af35fd55-5fe2-48da-8334-3d715b66f449', 'volume_name': 'volume-af35fd55-5fe2-48da-8334-3d715b66f449', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7151eae-5a18-4038-84cc-955c96fd1f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7151eae-5a18-4038-84cc-955c96fd1f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5a61dd-3ece-4e7e-8df5-a9b331862ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Volume af35fd55-5fe2-48da-8334-3d715b66f449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af35fd55-5fe2-48da-8334-3d715b66f449', 'volume_size': 1} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-397062376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af35fd55-5fe2-48da-8334-3d715b66f449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:07Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Creating volume af35fd55-5fe2-48da-8334-3d715b66f449 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:07 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:07 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 1073741824 Sep 01 02:08:07 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:08 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 1073741824" returned: 0 in 0.812s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:08 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 Sep 01 02:08:08 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:08 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5a61dd-3ece-4e7e-8df5-a9b331862ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af35fd55-5fe2-48da-8334-3d715b66f449', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf25700-59b7-4185-8859-c5b4bf087622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Volume volume-af35fd55-5fe2-48da-8334-3d715b66f449 (af35fd55-5fe2-48da-8334-3d715b66f449): created successfully Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf25700-59b7-4185-8859-c5b4bf087622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (bfef365d-1939-4791-b0ea-5733fe0a916c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-964b36fd-a271-4880-a1c3-334a1b5c9311 tempest-VolumesListAdminTestJSON-989708742 None] Created volume successfully. Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Flow 'volume_create_manager' (913413f3-250e-4944-817c-07d5280e0e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170f2d6-ff6b-4615-8a98-109e9138dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170f2d6-ff6b-4615-8a98-109e9138dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-672775265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a9e22-de30-4a74-897d-6b563a66f1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1b76dddfa64eedbd7270bf85ca17be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:09Z,use_quota=True,user_id='76087fa9472145a6afcf773394bb9e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9340be2-e4d7-4bea-a034-a92e5f268db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9340be2-e4d7-4bea-a034-a92e5f268db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57457c16-d95a-452d-af74-a4c3f521c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57457c16-d95a-452d-af74-a4c3f521c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271a9e22-de30-4a74-897d-6b563a66f1ac', 'volume_name': 'volume-271a9e22-de30-4a74-897d-6b563a66f1ac', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0420c1fd-3539-4dbb-b418-39bf0edc0c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0420c1fd-3539-4dbb-b418-39bf0edc0c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859020b0-d59d-4e68-b2f7-5e36615cb17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume 271a9e22-de30-4a74-897d-6b563a66f1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271a9e22-de30-4a74-897d-6b563a66f1ac', 'volume_size': 1} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-672775265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a9e22-de30-4a74-897d-6b563a66f1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1b76dddfa64eedbd7270bf85ca17be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:09Z,use_quota=True,user_id='76087fa9472145a6afcf773394bb9e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Creating volume 271a9e22-de30-4a74-897d-6b563a66f1ac {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:09 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:09 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac 1073741824 Sep 01 02:08:09 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=89,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=4 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=80,cinder:SELECT=110,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-71a000cb-4e25-4164-9bb3-360f8175d1a3 req-2f7ef29a-d9c6-447e-a7b4-b95dd29b6e93 tempest-ServerActionsTestOtherA-1734043553 None] Terminate volume connection completed successfully. Sep 01 02:08:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-71a000cb-4e25-4164-9bb3-360f8175d1a3 req-2f7ef29a-d9c6-447e-a7b4-b95dd29b6e93 tempest-ServerActionsTestOtherA-1734043553 None] Deleting attachment 35eead3d-9bef-4761-b347-e63d986bb3c1. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:10 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac 1073741824" returned: 0 in 0.719s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac Sep 01 02:08:10 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (a6542351-1071-469c-b3db-d2af58d8c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da43572-4462-4b84-b056-1198efe4e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da43572-4462-4b84-b056-1198efe4e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-921585054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081aa08f-7b27-4260-a755-a08841d390e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3beb73-9b18-4858-87da-85082f1d4d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3beb73-9b18-4858-87da-85082f1d4d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0193cfce-6b5a-4dfe-9217-21aa0ddf1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0193cfce-6b5a-4dfe-9217-21aa0ddf1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081aa08f-7b27-4260-a755-a08841d390e5', 'volume_name': 'volume-081aa08f-7b27-4260-a755-a08841d390e5', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f0685c-fff4-4ba3-a365-710fd73cb7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f0685c-fff4-4ba3-a365-710fd73cb7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74477b9f-3acb-47e0-8457-c7cad9709fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Volume 081aa08f-7b27-4260-a755-a08841d390e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081aa08f-7b27-4260-a755-a08841d390e5', 'volume_size': 1} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:10 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac" returned: 0 in 0.289s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-921585054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081aa08f-7b27-4260-a755-a08841d390e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Creating volume 081aa08f-7b27-4260-a755-a08841d390e5 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:10 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 1073741824 Sep 01 02:08:10 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859020b0-d59d-4e68-b2f7-5e36615cb17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271a9e22-de30-4a74-897d-6b563a66f1ac', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec887d-b4d9-4e63-a676-c8cfad548b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume volume-271a9e22-de30-4a74-897d-6b563a66f1ac (271a9e22-de30-4a74-897d-6b563a66f1ac): created successfully Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec887d-b4d9-4e63-a676-c8cfad548b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Flow 'volume_create_manager' (913413f3-250e-4944-817c-07d5280e0e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-1db59d6d-4cea-4670-932c-745305fc3367 tempest-VolumeQuotasAdminTestJSON-451845223 None] Created volume successfully. Sep 01 02:08:11 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 1073741824" returned: 0 in 0.596s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 Sep 01 02:08:11 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "cinder-271a9e22-de30-4a74-897d-6b563a66f1ac-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "cinder-271a9e22-de30-4a74-897d-6b563a66f1ac-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "cinder-quobyte-271a9e22-de30-4a74-897d-6b563a66f1ac" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "cinder-quobyte-271a9e22-de30-4a74-897d-6b563a66f1ac" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db6fda-ad4f-4439-975f-48dd5535d514]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5" returned: 0 in 0.678s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74477b9f-3acb-47e0-8457-c7cad9709fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081aa08f-7b27-4260-a755-a08841d390e5', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd22b3a5-fe9a-4ccc-b878-4008bf7ca626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Volume volume-081aa08f-7b27-4260-a755-a08841d390e5 (081aa08f-7b27-4260-a755-a08841d390e5): created successfully Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd22b3a5-fe9a-4ccc-b878-4008bf7ca626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (a6542351-1071-469c-b3db-d2af58d8c124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-44a7c94c-8d42-46fb-aa48-d086d793f808 tempest-VolumesListAdminTestJSON-989708742 None] Created volume successfully. Sep 01 02:08:11 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac Sep 01 02:08:11 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac" returned: 0 in 0.482s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac Sep 01 02:08:12 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-271a9e22-de30-4a74-897d-6b563a66f1ac" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "cinder-quobyte-271a9e22-de30-4a74-897d-6b563a66f1ac" released by "delete_volume" :: held 0.861s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Created reservations ['9718123d-e742-44ad-8ae5-803cf1df9aec', 'def81e4b-6f95-4647-b61c-0ba8c25ad248', '4d12e25b-7df3-468c-a88f-b51315174a88', '2cb4f620-76dc-4784-9d42-4e58697e1589'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:12 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.483s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Deleted volume successfully. Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3fb5d100-2857-41e6-a608-d60c2bd9d719 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "cinder-271a9e22-de30-4a74-897d-6b563a66f1ac-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Flow 'volume_create_manager' (3f4514c5-788e-4cef-a850-5149468a9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9449a8db-582e-4e68-b368-383eca49f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9449a8db-582e-4e68-b368-383eca49f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1844467642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086fc52f-7c3c-4e07-9c9d-7ab5790998cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1b76dddfa64eedbd7270bf85ca17be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='76087fa9472145a6afcf773394bb9e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcb4c57-ea2f-4fe9-b528-71194b05123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcb4c57-ea2f-4fe9-b528-71194b05123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2246d85c-b67d-4e21-b610-03efa5c03c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2246d85c-b67d-4e21-b610-03efa5c03c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086fc52f-7c3c-4e07-9c9d-7ab5790998cd', 'volume_name': 'volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484410b-a220-48cd-8417-1b479d2f686d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484410b-a220-48cd-8417-1b479d2f686d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e831d743-8fb3-4836-856b-d2f78cc9a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume 086fc52f-7c3c-4e07-9c9d-7ab5790998cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd', 'volume_size': 1} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1844467642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086fc52f-7c3c-4e07-9c9d-7ab5790998cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1b76dddfa64eedbd7270bf85ca17be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='76087fa9472145a6afcf773394bb9e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Creating volume 086fc52f-7c3c-4e07-9c9d-7ab5790998cd {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:14 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd 1073741824 Sep 01 02:08:14 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (44ef2016-9b73-49c2-83f8-bbf323f2f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de77084d-8089-4c60-8df5-571bf7e7126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de77084d-8089-4c60-8df5-571bf7e7126d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1223138540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e906e48-21c7-44d0-b505-1badeaf41a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ed1532-a108-4e0d-8dde-f42214c8111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ed1532-a108-4e0d-8dde-f42214c8111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b109a2d2-4ac8-443a-81e9-9bcfc51c6928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b109a2d2-4ac8-443a-81e9-9bcfc51c6928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e906e48-21c7-44d0-b505-1badeaf41a6d', 'volume_name': 'volume-1e906e48-21c7-44d0-b505-1badeaf41a6d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a611c6d-59f4-4ab3-afbe-729ca6b63942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a611c6d-59f4-4ab3-afbe-729ca6b63942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb40d458-d426-4679-a2b4-aa5868a88c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Volume 1e906e48-21c7-44d0-b505-1badeaf41a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e906e48-21c7-44d0-b505-1badeaf41a6d', 'volume_size': 1} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd 1073741824" returned: 0 in 0.480s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd Sep 01 02:08:14 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" returned: 0 in 0.322s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1223138540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e906e48-21c7-44d0-b505-1badeaf41a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aa7144c3ac4024a0ed6764f7dd5f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='bccdefdc616d4517b9cb73645f0fd93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Creating volume 1e906e48-21c7-44d0-b505-1badeaf41a6d {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e831d743-8fb3-4836-856b-d2f78cc9a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a549-7ee5-42f3-85d7-7b96e203fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d 1073741824 Sep 01 02:08:14 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Volume volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd (086fc52f-7c3c-4e07-9c9d-7ab5790998cd): created successfully Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a549-7ee5-42f3-85d7-7b96e203fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Flow 'volume_create_manager' (3f4514c5-788e-4cef-a850-5149468a9950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5888904a-cdb9-4f24-a362-55a3428b5a41 tempest-VolumeQuotasAdminTestJSON-451845223 None] Created volume successfully. Sep 01 02:08:15 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d 1073741824" returned: 0 in 0.532s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:15 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d Sep 01 02:08:15 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:15 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d" returned: 0 in 0.366s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb40d458-d426-4679-a2b4-aa5868a88c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e906e48-21c7-44d0-b505-1badeaf41a6d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661d9610-e5ff-4e67-b95a-a7cbb22ff671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Volume volume-1e906e48-21c7-44d0-b505-1badeaf41a6d (1e906e48-21c7-44d0-b505-1badeaf41a6d): created successfully Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661d9610-e5ff-4e67-b95a-a7cbb22ff671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Flow 'volume_create_manager' (44ef2016-9b73-49c2-83f8-bbf323f2f486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8ef3d53b-45a5-441b-bc21-d403f37977b5 tempest-VolumesListAdminTestJSON-989708742 None] Created volume successfully. Sep 01 02:08:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e0fe27ca-d88a-40b6-96e8-a8b5b1c46789 tempest-VolumeQuotasAdminTestJSON-181321372 None] Transfer volume completed successfully. Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Acquiring lock "cinder-086fc52f-7c3c-4e07-9c9d-7ab5790998cd-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "cinder-086fc52f-7c3c-4e07-9c9d-7ab5790998cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Acquiring lock "cinder-quobyte-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "cinder-quobyte-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" acquired by "delete_volume" :: waited 0.048s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d6232-a4a5-403a-b651-e289bf4781fc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Flow 'volume_create_manager' (52f4c47d-83ce-4bd9-9120-43cce91f0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aba24f5-20bf-4251-8e0d-42422e0aa04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aba24f5-20bf-4251-8e0d-42422e0aa04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-137557573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66bd733-63d6-4e8e-b614-e84112a3ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e18f5cfe43c4eb4a311b46a82986172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:17Z,use_quota=True,user_id='61057d5f794e430ca8d2cb37ec1d72ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fdd813-9d47-4f3c-ae88-8829336c35b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fdd813-9d47-4f3c-ae88-8829336c35b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605deb4c-edbc-440a-ac1e-1e947887cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:08:17 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd Sep 01 02:08:17 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" returned: 0 in 0.605s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605deb4c-edbc-440a-ac1e-1e947887cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a66bd733-63d6-4e8e-b614-e84112a3ac38', 'volume_name': 'volume-a66bd733-63d6-4e8e-b614-e84112a3ac38', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c1247-64bf-4e30-9a6c-22042ca5445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c1247-64bf-4e30-9a6c-22042ca5445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9343ebc0-7e32-417a-bdfe-12be6bcc6ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Volume a66bd733-63d6-4e8e-b614-e84112a3ac38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a66bd733-63d6-4e8e-b614-e84112a3ac38', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Trying to clone a66bd733-63d6-4e8e-b614-e84112a3ac38 from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:08:17 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Flow 'volume_create_manager' (f9bed8bd-8ae9-40f4-b57d-9c2c248f7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092afe7f-2037-468e-9677-55ccc6ef2cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092afe7f-2037-468e-9677-55ccc6ef2cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a5267-f4ac-4cb2-a68e-18de0cc69898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695895679bfb4b7196b35b35dd676f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:18Z,use_quota=True,user_id='02983d3523514068bcd7e07a95c87864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8219471-efc9-4de1-8d02-c3f75c9ca811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8219471-efc9-4de1-8d02-c3f75c9ca811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f4f5b-aecc-4a92-8228-c7c1fcac5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f4f5b-aecc-4a92-8228-c7c1fcac5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75a5267-f4ac-4cb2-a68e-18de0cc69898', 'volume_name': 'volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c774f34b-3efd-442c-b959-bb0880542f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c774f34b-3efd-442c-b959-bb0880542f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a92cba-ab98-4cf9-975d-fbe6365d331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Volume b75a5267-f4ac-4cb2-a68e-18de0cc69898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898', 'volume_size': 1} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a5267-f4ac-4cb2-a68e-18de0cc69898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695895679bfb4b7196b35b35dd676f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:18Z,use_quota=True,user_id='02983d3523514068bcd7e07a95c87864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Creating volume b75a5267-f4ac-4cb2-a68e-18de0cc69898 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 1073741824 Sep 01 02:08:18 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" returned: 0 in 0.364s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "cinder-quobyte-086fc52f-7c3c-4e07-9c9d-7ab5790998cd" released by "delete_volume" :: held 1.059s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:08:18 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Created reservations ['9aa7ec6f-f714-4e82-913a-f0923530a213', '6035a371-af58-4344-812e-548d58edd3a4', 'cda97228-f542-4001-b3f0-47b4a26d4181', '5b98974f-4d11-42d7-8dfc-dd297957f996'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[946fbbd7-e20a-4f98-8dac-893937f2d0f5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:18 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD Sep 01 02:08:18 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 1073741824" returned: 0 in 0.643s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 Sep 01 02:08:18 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.288s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Deleted volume successfully. Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-41be191d-9ad5-45ad-b029-5e9ca9955161 tempest-VolumeQuotasAdminTestJSON-1024597781 None] Lock "cinder-086fc52f-7c3c-4e07-9c9d-7ab5790998cd-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:18 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 is fetched for user 61057d5f794e430ca8d2cb37ec1d72ba. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c761c6a-e96a-48ee-83a6-5e3fa746be28]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:19 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898" returned: 0 in 0.321s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a92cba-ab98-4cf9-975d-fbe6365d331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:19 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD Sep 01 02:08:19 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438136c7-fb52-40dd-8f2d-119e067e1292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Volume volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 (b75a5267-f4ac-4cb2-a68e-18de0cc69898): created successfully Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438136c7-fb52-40dd-8f2d-119e067e1292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Flow 'volume_create_manager' (f9bed8bd-8ae9-40f4-b57d-9c2c248f7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c3bd54bb-c3d9-44ce-a18f-05c5a7bd33d4 tempest-VolumesListAdminTestJSON-148216399 None] Created volume successfully. Sep 01 02:08:19 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-137557573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66bd733-63d6-4e8e-b614-e84112a3ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e18f5cfe43c4eb4a311b46a82986172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:17Z,use_quota=True,user_id='61057d5f794e430ca8d2cb37ec1d72ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Creating volume a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:19 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1073741824 Sep 01 02:08:19 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:19 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1073741824" returned: 0 in 0.598s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 Sep 01 02:08:20 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Acquiring lock "cinder-b75a5267-f4ac-4cb2-a68e-18de0cc69898-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "cinder-b75a5267-f4ac-4cb2-a68e-18de0cc69898-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Acquiring lock "cinder-quobyte-b75a5267-f4ac-4cb2-a68e-18de0cc69898" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "cinder-quobyte-b75a5267-f4ac-4cb2-a68e-18de0cc69898" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea661f5-3e42-4384-bc98-637a5b6e97a7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38" returned: 0 in 0.364s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-1e906e48-21c7-44d0-b505-1badeaf41a6d-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-1e906e48-21c7-44d0-b505-1badeaf41a6d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 Sep 01 02:08:20 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Attempting download of 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume a66bd733-63d6-4e8e-b614-e84112a3ac38. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-quobyte-1e906e48-21c7-44d0-b505-1badeaf41a6d" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7372938e-95f6-4776-807c-1e4a591cecb2]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-1e906e48-21c7-44d0-b505-1badeaf41a6d" acquired by "delete_volume" :: waited 0.039s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa120d7f-cff3-45b4-89ac-6a12947b954a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5 Sep 01 02:08:20 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d Sep 01 02:08:20 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898" returned: 0 in 0.510s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898 Sep 01 02:08:20 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5" returned: 0 in 0.433s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d" returned: 0 in 0.547s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5 Sep 01 02:08:21 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b75a5267-f4ac-4cb2-a68e-18de0cc69898" returned: 0 in 0.379s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d Sep 01 02:08:21 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "cinder-quobyte-b75a5267-f4ac-4cb2-a68e-18de0cc69898" released by "delete_volume" :: held 0.966s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Created reservations ['21eed9a9-b8f4-47a6-bb2b-670f0044909a', '24ad4cc9-d73d-4485-8b08-e7bc27fcdcc5', '53d25c21-08c8-4d8a-97b2-7890a8d37ba4', '98fb8f79-76a5-4c15-a0e1-21c84c87206d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:21 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1e906e48-21c7-44d0-b505-1badeaf41a6d" returned: 0 in 0.316s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-1e906e48-21c7-44d0-b505-1badeaf41a6d" released by "delete_volume" :: held 0.943s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:21 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5" returned: 1 in 0.583s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_ektf_px5' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd95d06-3a86-461e-a6f8-0b9faf96a2dc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Created reservations ['d2551707-c511-4845-90e5-43e329691df5', '779ffaef-84a3-415a-8a94-4dfc72f88f72', 'b8306bd3-554f-4350-a9ee-922b11ff9360', '8dce3830-9237-41a9-8ca8-9f4db275a994'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:21 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.328s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD Sep 01 02:08:21 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Deleted volume successfully. Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f55abc03-afd0-4c7c-a45a-f51bf6cb45c6 tempest-VolumesListAdminTestJSON-148216399 None] Lock "cinder-b75a5267-f4ac-4cb2-a68e-18de0cc69898-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:21 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:21 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] 514cc436-eb47-42bc-a3be-d669f2c6dfb1 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 Sep 01 02:08:22 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Deleted volume successfully. Sep 01 02:08:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-905b7d18-0c18-4f7a-95d4-f6d61f7967d6 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-1e906e48-21c7-44d0-b505-1badeaf41a6d-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-081aa08f-7b27-4260-a755-a08841d390e5-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-081aa08f-7b27-4260-a755-a08841d390e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-quobyte-081aa08f-7b27-4260-a755-a08841d390e5" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-081aa08f-7b27-4260-a755-a08841d390e5" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3ace8d-8675-4450-b129-d2af33b02f4a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 Sep 01 02:08:23 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:23 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5" returned: 0 in 0.441s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5 Sep 01 02:08:23 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:23 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-081aa08f-7b27-4260-a755-a08841d390e5" returned: 0 in 0.312s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-081aa08f-7b27-4260-a755-a08841d390e5" released by "delete_volume" :: held 0.802s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Created reservations ['da1b127b-204b-4513-8803-6951e6229319', 'fb529c24-9182-4748-adb5-17a30c6f52e2', '63732f78-9442-43d7-846e-822741884ba5', '461fad71-db8d-45c9-9613-d8e7b9466844'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38" returned: 0 in 2.147s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_gferv2ikdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:24 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Converted 112.00 MB image at 52.11 MB/s Sep 01 02:08:24 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:24 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1G Sep 01 02:08:24 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-af35fd55-5fe2-48da-8334-3d715b66f449-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-af35fd55-5fe2-48da-8334-3d715b66f449-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:24 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "cinder-quobyte-af35fd55-5fe2-48da-8334-3d715b66f449" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.375s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Deleted volume successfully. Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-af35fd55-5fe2-48da-8334-3d715b66f449" acquired by "delete_volume" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-93c992ca-40b0-4c76-a57c-8bba5b3328a8 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-081aa08f-7b27-4260-a755-a08841d390e5-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e843fce-046d-4249-9785-b244f1fb8bf0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 1G" returned: 0 in 0.446s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Downloaded image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume a66bd733-63d6-4e8e-b614-e84112a3ac38 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 for user 61057d5f794e430ca8d2cb37ec1d72ba is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Marking volume a66bd733-63d6-4e8e-b614-e84112a3ac38 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Copying metadata from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 to a66bd733-63d6-4e8e-b614-e84112a3ac38. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Creating volume glance metadata for volume a66bd733-63d6-4e8e-b614-e84112a3ac38 backed by image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:08:24 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 Sep 01 02:08:24 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9343ebc0-7e32-417a-bdfe-12be6bcc6ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66bd733-63d6-4e8e-b614-e84112a3ac38', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709690d2-f2b1-4de4-bc0e-269bb714f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Volume volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 (a66bd733-63d6-4e8e-b614-e84112a3ac38): created successfully Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709690d2-f2b1-4de4-bc0e-269bb714f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Flow 'volume_create_manager' (52f4c47d-83ce-4bd9-9120-43cce91f0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e84c3641-bf68-4c50-a761-e939209661b8 tempest-ServerActionsTestOtherA-1734043553 None] Created volume successfully. Sep 01 02:08:25 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449" returned: 0 in 0.425s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449 Sep 01 02:08:25 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af35fd55-5fe2-48da-8334-3d715b66f449" returned: 0 in 0.275s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-quobyte-af35fd55-5fe2-48da-8334-3d715b66f449" released by "delete_volume" :: held 0.754s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Created reservations ['75163848-87c0-46f5-94b7-098e0baefb14', '90fbe9f2-e6b9-49c5-b4b4-8562ff0b9483', '6c9ef26f-7c9b-41f3-8603-3aee3caef3a8', '649b6478-4dd3-4e56-af9c-698d14a3b116'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:25 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Deleted volume successfully. Sep 01 02:08:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ea90915b-065b-422f-8efb-b470585ece35 tempest-VolumesListAdminTestJSON-989708742 None] Lock "cinder-af35fd55-5fe2-48da-8334-3d715b66f449-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Flow 'volume_create_manager' (49d6dc0d-08ce-4e1a-aac7-d34202e32290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700f938c-a4de-4ba1-903c-378e0c025a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700f938c-a4de-4ba1-903c-378e0c025a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-255841497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e68293-8355-46c5-8a40-77175487cf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94a80fd799a43ecb6a83a8aca0259b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:28Z,use_quota=True,user_id='ea1603a293044756b5f364606e780f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(292a8a44-d53a-4178-bcf4-3c239ad5d218),volume_type_id=292a8a44-d53a-4178-bcf4-3c239ad5d218)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39147f-3f75-4867-a381-c975917cedd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39147f-3f75-4867-a381-c975917cedd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4816a67-2853-4120-9b48-d52020ca2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4816a67-2853-4120-9b48-d52020ca2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e68293-8355-46c5-8a40-77175487cf59', 'volume_name': 'volume-f3e68293-8355-46c5-8a40-77175487cf59', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c27b5fe-02d4-470c-8140-f1cc267d6223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c27b5fe-02d4-470c-8140-f1cc267d6223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e9ad8e-19f7-4bac-88de-10eb7662b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Volume f3e68293-8355-46c5-8a40-77175487cf59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e68293-8355-46c5-8a40-77175487cf59', 'volume_size': 1} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-255841497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e68293-8355-46c5-8a40-77175487cf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94a80fd799a43ecb6a83a8aca0259b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:28Z,use_quota=True,user_id='ea1603a293044756b5f364606e780f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(292a8a44-d53a-4178-bcf4-3c239ad5d218),volume_type_id=292a8a44-d53a-4178-bcf4-3c239ad5d218)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Creating volume f3e68293-8355-46c5-8a40-77175487cf59 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:28 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 1073741824 Sep 01 02:08:28 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-18933d71-fb06-4662-8564-9400be740b6d req-7957170f-0d36-4627-88fc-65cc792e2f18 tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:29 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 1073741824" returned: 0 in 0.624s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 Sep 01 02:08:29 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-18933d71-fb06-4662-8564-9400be740b6d req-7957170f-0d36-4627-88fc-65cc792e2f18 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.601s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-18933d71-fb06-4662-8564-9400be740b6d req-7957170f-0d36-4627-88fc-65cc792e2f18 tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e9ad8e-19f7-4bac-88de-10eb7662b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e68293-8355-46c5-8a40-77175487cf59', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267165f5-032e-42e3-9c4a-f5c20574d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Volume volume-f3e68293-8355-46c5-8a40-77175487cf59 (f3e68293-8355-46c5-8a40-77175487cf59): created successfully Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267165f5-032e-42e3-9c4a-f5c20574d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Flow 'volume_create_manager' (49d6dc0d-08ce-4e1a-aac7-d34202e32290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-18933d71-fb06-4662-8564-9400be740b6d req-7957170f-0d36-4627-88fc-65cc792e2f18 tempest-ServerActionsTestOtherA-1734043553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-a66bd733-63d6-4e8e-b614-e84112a3ac38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '940e28f3-b1ad-4d28-8a43-4765490b94bc', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fc8c3576-a329-4257-b7f8-653e44e00f55 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Created volume successfully. Sep 01 02:08:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-18933d71-fb06-4662-8564-9400be740b6d req-7957170f-0d36-4627-88fc-65cc792e2f18 tempest-ServerActionsTestOtherA-1734043553 None] attachment_update completed successfully. Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:31 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:31 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:31 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.315s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-585e18a2-73dd-4b25-b372-ef9f79217b24 tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Retype volume completed successfully. Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "cinder-f3e68293-8355-46c5-8a40-77175487cf59-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "cinder-f3e68293-8355-46c5-8a40-77175487cf59-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "cinder-quobyte-f3e68293-8355-46c5-8a40-77175487cf59" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "cinder-quobyte-f3e68293-8355-46c5-8a40-77175487cf59" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a94f5-308c-436b-8f01-878b91c62dd1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:32 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 Sep 01 02:08:32 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:33 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59" returned: 0 in 0.461s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59 Sep 01 02:08:33 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:33 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f3e68293-8355-46c5-8a40-77175487cf59" returned: 0 in 0.457s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "cinder-quobyte-f3e68293-8355-46c5-8a40-77175487cf59" released by "delete_volume" :: held 1.003s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:33 devstack cinder-volume[86925]: WARNING cinder.quota [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:08:33 devstack cinder-volume[86925]: WARNING cinder.quota [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Created reservations ['996e922a-efd2-4258-b5b4-df47f8d79880', '27a184db-3d4e-4f97-9086-6389890e1fce', 'f13b0190-9faa-4e69-a599-405be32f8012', 'abdc83e6-67ff-49d5-b113-4baf965377a2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:33 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.352s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Deleted volume successfully. Sep 01 02:08:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0d736c42-dd3b-4591-9f9a-3d97f9114e7d tempest-VolumeRetypeWithoutMigrationTest-2003502246 None] Lock "cinder-f3e68293-8355-46c5-8a40-77175487cf59-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:40 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:40 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:41 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.326s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:08:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Flow 'volume_create_manager' (67a2e249-ca12-448a-9f6a-fe29a66c7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed77bc-dcd4-460b-bc65-a19017d3416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed77bc-dcd4-460b-bc65-a19017d3416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2021918051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03fa624-407c-42e3-96f9-b2526984c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a004672724eb4dfdbb536fdd4bb36e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:44Z,use_quota=True,user_id='df2d2b1cce274689b50e782932e70f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a795d9-2c5f-4a61-9846-703b7d31986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a795d9-2c5f-4a61-9846-703b7d31986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab70a34-c936-4b2e-b6bf-af4f9fa052f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab70a34-c936-4b2e-b6bf-af4f9fa052f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03fa624-407c-42e3-96f9-b2526984c547', 'volume_name': 'volume-d03fa624-407c-42e3-96f9-b2526984c547', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e816f1a3-3295-4cd2-8d7d-cfeca3fa5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e816f1a3-3295-4cd2-8d7d-cfeca3fa5adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468c0569-e18b-4e23-a227-3ba0e77e10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:43 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Volume d03fa624-407c-42e3-96f9-b2526984c547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03fa624-407c-42e3-96f9-b2526984c547', 'volume_size': 1} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2021918051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03fa624-407c-42e3-96f9-b2526984c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a004672724eb4dfdbb536fdd4bb36e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:44Z,use_quota=True,user_id='df2d2b1cce274689b50e782932e70f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Creating volume d03fa624-407c-42e3-96f9-b2526984c547 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:43 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:44 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 1073741824 Sep 01 02:08:44 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Flow 'volume_create_manager' (f6ade6e7-d67b-4ac7-9573-b8c784552710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137158ea-a02b-4048-90a1-8eecf3a3495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137158ea-a02b-4048-90a1-8eecf3a3495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-159368652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865f4d7-2f8f-4116-b1ce-209cfc2dca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb6d1cbc5ce4e8abf6e83501fa9aeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:44Z,use_quota=True,user_id='7b54826c737e4adabc377a8764d2c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2774df7a-3ec9-4e89-8e93-fa079551a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2774df7a-3ec9-4e89-8e93-fa079551a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a5568f-b035-4c09-af22-cee8e132947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a5568f-b035-4c09-af22-cee8e132947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2865f4d7-2f8f-4116-b1ce-209cfc2dca7c', 'volume_name': 'volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c18f271-a258-441c-b127-c9c2e863290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c18f271-a258-441c-b127-c9c2e863290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b0f78-a7a1-40de-bc57-54d52dbb70a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Volume 2865f4d7-2f8f-4116-b1ce-209cfc2dca7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c', 'volume_size': 1} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:44 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 1073741824" returned: 0 in 0.595s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:44 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 Sep 01 02:08:44 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:45 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547" returned: 0 in 0.473s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-159368652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865f4d7-2f8f-4116-b1ce-209cfc2dca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb6d1cbc5ce4e8abf6e83501fa9aeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:44Z,use_quota=True,user_id='7b54826c737e4adabc377a8764d2c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Creating volume 2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:45 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468c0569-e18b-4e23-a227-3ba0e77e10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03fa624-407c-42e3-96f9-b2526984c547', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f3f9d9-96a9-46a3-9f45-401ebbdd9391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:45 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c 1073741824 Sep 01 02:08:45 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:45 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Volume volume-d03fa624-407c-42e3-96f9-b2526984c547 (d03fa624-407c-42e3-96f9-b2526984c547): created successfully Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f3f9d9-96a9-46a3-9f45-401ebbdd9391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Flow 'volume_create_manager' (67a2e249-ca12-448a-9f6a-fe29a66c7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a53f47d8-1b11-45cf-80bc-a58a15451f3e tempest-VolumesTransfersV355Test-755138652 None] Created volume successfully. Sep 01 02:08:45 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c 1073741824" returned: 0 in 0.799s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:46 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c Sep 01 02:08:46 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:46 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" returned: 0 in 0.475s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b0f78-a7a1-40de-bc57-54d52dbb70a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b40c8fa-791b-46b8-a422-e77c7c624db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:46 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Volume volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c (2865f4d7-2f8f-4116-b1ce-209cfc2dca7c): created successfully Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b40c8fa-791b-46b8-a422-e77c7c624db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:46 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Flow 'volume_create_manager' (f6ade6e7-d67b-4ac7-9573-b8c784552710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-adf7dce6-5032-4473-a4f5-801db519d3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Created volume successfully. Sep 01 02:08:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-130d6a0d-4f84-4a99-8ab3-1645f07ce576 tempest-VolumesTransfersV355Test-1161909402 None] Transfer volume completed successfully. Sep 01 02:08:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-62245a13-0103-411f-8d88-a9024cdaf9c2 tempest-ServerActionsTestOtherA-1734043553 None] Terminate volume connection completed successfully. Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-62245a13-0103-411f-8d88-a9024cdaf9c2 tempest-ServerActionsTestOtherA-1734043553 None] Deleting attachment 940e28f3-b1ad-4d28-8a43-4765490b94bc. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Creating offline snapshot fa04d434-61bc-469e-8c8c-4811f0bb981c of volume 2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[01418053-cb32-4e7a-b9c6-831e2aef10ed]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c Sep 01 02:08:48 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "cinder-d03fa624-407c-42e3-96f9-b2526984c547-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-d03fa624-407c-42e3-96f9-b2526984c547-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "cinder-quobyte-d03fa624-407c-42e3-96f9-b2526984c547" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-quobyte-d03fa624-407c-42e3-96f9-b2526984c547" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5b254-4490-4573-9c2f-e3ec5373274d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 Sep 01 02:08:48 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" returned: 0 in 0.559s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c 1G Sep 01 02:08:48 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547" returned: 0 in 0.624s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547 Sep 01 02:08:48 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-5792952f-7638-4e64-9304-8f773d40908b req-efce85ae-6642-420d-89a3-bcfa452c864e tempest-TestShelveInstance-646908429 None] Terminate volume connection completed successfully. Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-5792952f-7638-4e64-9304-8f773d40908b req-efce85ae-6642-420d-89a3-bcfa452c864e tempest-TestShelveInstance-646908429 None] Deleting attachment 4aac2a67-d551-4fc0-aea7-6ae1f7d41fc6. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:49 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c 1G" returned: 0 in 0.722s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c Sep 01 02:08:49 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d03fa624-407c-42e3-96f9-b2526984c547" returned: 0 in 0.420s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-quobyte-d03fa624-407c-42e3-96f9-b2526984c547" released by "delete_volume" :: held 1.107s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Created reservations ['d312b199-7ba1-49d5-85ef-6b80cbfe53ec', '572cd325-2dc5-4657-b5fb-051a74206fad', 'd0d07405-2e89-4db9-8ba5-b93729584e7a', '93c068e8-6f7a-493f-8ffc-a0cfe719cdfe'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:49 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c" returned: 0 in 0.451s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c is being set with open permissions: ugo+rw Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c Sep 01 02:08:49 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Deleted volume successfully. Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6583af3e-61ac-4051-93ec-143e55ffe82d tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-d03fa624-407c-42e3-96f9-b2526984c547-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-e08a5199-9676-441f-bdb6-8aecef08ccea tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:50 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c" returned: 0 in 0.462s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info Sep 01 02:08:50 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info" returned: 0 in 0.360s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info is being set with open permissions: ugo+rw Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info Sep 01 02:08:50 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.info" returned: 0 in 0.383s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-e08a5199-9676-441f-bdb6-8aecef08ccea tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.870s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-e08a5199-9676-441f-bdb6-8aecef08ccea tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-201915dd-6ec1-4621-bb26-073b01606c08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Create snapshot completed successfully Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-e08a5199-9676-441f-bdb6-8aecef08ccea tempest-ServerActionsTestOtherA-1734043553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-a66bd733-63d6-4e8e-b614-e84112a3ac38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73637463-6aa0-4f28-859d-63207e1bcbfb', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ba7a5c29-8a01-49b1-8014-497f9d985aae req-e08a5199-9676-441f-bdb6-8aecef08ccea tempest-ServerActionsTestOtherA-1734043553 None] attachment_update completed successfully. Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Flow 'volume_create_manager' (da72c299-a380-445d-9a09-86d4ada3a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb01a063-26bf-43ba-9d7c-b756d6056489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb01a063-26bf-43ba-9d7c-b756d6056489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1053570816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db381cfd-d6f9-430d-874f-e0015996464f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a004672724eb4dfdbb536fdd4bb36e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:51Z,use_quota=True,user_id='df2d2b1cce274689b50e782932e70f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234a9d74-2fee-47cc-aa06-39817c984bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234a9d74-2fee-47cc-aa06-39817c984bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533668e8-4367-4aa7-94a6-a1522e141104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533668e8-4367-4aa7-94a6-a1522e141104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db381cfd-d6f9-430d-874f-e0015996464f', 'volume_name': 'volume-db381cfd-d6f9-430d-874f-e0015996464f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80d05da-b7d3-4416-863d-8ecff5706855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80d05da-b7d3-4416-863d-8ecff5706855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a810f3dc-ddd3-4ece-aa4b-7983b1c4d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Volume db381cfd-d6f9-430d-874f-e0015996464f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db381cfd-d6f9-430d-874f-e0015996464f', 'volume_size': 1} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1053570816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db381cfd-d6f9-430d-874f-e0015996464f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a004672724eb4dfdbb536fdd4bb36e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:51Z,use_quota=True,user_id='df2d2b1cce274689b50e782932e70f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Creating volume db381cfd-d6f9-430d-874f-e0015996464f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:51 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f 1073741824 Sep 01 02:08:51 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f 1073741824" returned: 0 in 0.657s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:52 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f Sep 01 02:08:52 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ea76ee19-84f7-41f3-a549-9da2125c0a91 req-399ef3d3-41ca-47eb-8a09-590bec279784 tempest-TestShelveInstance-646908429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:52 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ea76ee19-84f7-41f3-a549-9da2125c0a91 req-399ef3d3-41ca-47eb-8a09-590bec279784 tempest-TestShelveInstance-646908429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-ea76ee19-84f7-41f3-a549-9da2125c0a91 req-399ef3d3-41ca-47eb-8a09-590bec279784 tempest-TestShelveInstance-646908429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a810f3dc-ddd3-4ece-aa4b-7983b1c4d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db381cfd-d6f9-430d-874f-e0015996464f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde6eb50-aa5a-4af2-be21-86ad9dac6f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:52 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Volume volume-db381cfd-d6f9-430d-874f-e0015996464f (db381cfd-d6f9-430d-874f-e0015996464f): created successfully Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde6eb50-aa5a-4af2-be21-86ad9dac6f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Flow 'volume_create_manager' (da72c299-a380-445d-9a09-86d4ada3a640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-120a9749-991f-40d1-a0d5-65e47ec3f5bb tempest-VolumesTransfersV355Test-755138652 None] Created volume successfully. Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ea76ee19-84f7-41f3-a549-9da2125c0a91 req-399ef3d3-41ca-47eb-8a09-590bec279784 tempest-TestShelveInstance-646908429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-a6155bcf-c0ac-4275-9e5b-6289b4061483', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53131fdd-86f9-46dd-9944-c4c83d71d072', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ea76ee19-84f7-41f3-a549-9da2125c0a91 req-399ef3d3-41ca-47eb-8a09-590bec279784 tempest-TestShelveInstance-646908429 None] attachment_update completed successfully. Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "cinder-fa04d434-61bc-469e-8c8c-4811f0bb981c-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-fa04d434-61bc-469e-8c8c-4811f0bb981c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "cinder-quobyte-fa04d434-61bc-469e-8c8c-4811f0bb981c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-fa04d434-61bc-469e-8c8c-4811f0bb981c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Deleting offline snapshot fa04d434-61bc-469e-8c8c-4811f0bb981c of volume 2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] snapshot_file for this snap is: volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[045a6df1-c443-4908-a2ed-0b926ee5269d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c Sep 01 02:08:53 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:53 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c" returned: 0 in 0.516s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[90144f31-8a59-4e98-9134-f53feee44517]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c Sep 01 02:08:53 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "cinder-db381cfd-d6f9-430d-874f-e0015996464f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-db381cfd-d6f9-430d-874f-e0015996464f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "cinder-quobyte-db381cfd-d6f9-430d-874f-e0015996464f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-quobyte-db381cfd-d6f9-430d-874f-e0015996464f" acquired by "delete_volume" :: waited 0.060s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a81d3-21b4-4577-bacb-8886c3abb7ac]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:54 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f Sep 01 02:08:54 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" returned: 0 in 0.734s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:54 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c Sep 01 02:08:54 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f" returned: 0 in 0.629s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:54 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f Sep 01 02:08:54 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c" returned: 0 in 0.631s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:55 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c Sep 01 02:08:55 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:55 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-db381cfd-d6f9-430d-874f-e0015996464f" returned: 0 in 0.640s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-quobyte-db381cfd-d6f9-430d-874f-e0015996464f" released by "delete_volume" :: held 1.410s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:55 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c.fa04d434-61bc-469e-8c8c-4811f0bb981c" returned: 0 in 0.499s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-fa04d434-61bc-469e-8c8c-4811f0bb981c" released by "_delete_snapshot" :: held 2.579s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" released by "delete_snapshot" :: held 2.613s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Created reservations ['d30144d6-f647-45b0-8b78-b7b28d2d58a1', '49d23386-5fc6-4504-a347-04afcc38c818', 'feba89b8-b0a3-42a1-a00f-f2dd16f69b41', 'e983b8e2-1478-4c2a-a6cb-58d8c307ea6f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Created reservations ['c67f90c9-067f-467b-a206-1d5e35e3a01f', 'b2c7a141-7423-4951-b16a-1bc0cd283d61', 'fe2b3cca-89aa-4b69-a90c-d4272aef2147', '639b89b4-5eb6-4ccb-b9d8-62e8d6efeb4b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:55 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:55 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Delete snapshot completed successfully. Sep 01 02:08:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d33cde3-fc20-4bd8-848e-440ec39b556b tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-fa04d434-61bc-469e-8c8c-4811f0bb981c-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:56 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Deleted volume successfully. Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-365cdf73-9fe9-474b-b70d-91f7d05fab57 tempest-VolumesTransfersV355Test-631564269 None] Lock "cinder-db381cfd-d6f9-430d-874f-e0015996464f-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "cinder-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" acquired by "delete_volume" :: waited 0.054s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4669c2-df1f-4bea-97b3-bdd32d2dd59a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:56 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c Sep 01 02:08:56 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:57 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" returned: 0 in 0.687s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:57 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c Sep 01 02:08:57 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:57 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" returned: 0 in 0.591s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-quobyte-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c" released by "delete_volume" :: held 1.422s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Created reservations ['16748001-c0cc-4031-b018-53f88065c26c', '323388dc-8cc4-4d8e-b890-b5d5e7d1d383', '6dea343c-4c14-47f5-9bcd-631cd0065929', '04dfed5a-027a-40f9-934a-ead2b3b06146'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:08:58 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.493s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Deleted volume successfully. Sep 01 02:08:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-510ef3f8-79d4-444d-940c-3a33536a13e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1395394951 None] Lock "cinder-2865f4d7-2f8f-4116-b1ce-209cfc2dca7c-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:08 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=109,cinder:UPDATE=142,cinder:INSERT=33,cinder:DELETE=7 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:09 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=122,cinder:UPDATE=113,cinder:DELETE=14,cinder:INSERT=35 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (866b042e-58db-4572-8beb-3ef39878c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ef19df-52bb-48b8-bb89-64ac39d06f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ef19df-52bb-48b8-bb89-64ac39d06f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1077316388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df42e7af-b9de-4e2f-b0fa-d3ed6339c11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:21Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a85981-9675-4543-9cc6-2784997d4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a85981-9675-4543-9cc6-2784997d4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0e5566-4f96-4131-940a-396a6e4a18bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0e5566-4f96-4131-940a-396a6e4a18bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df42e7af-b9de-4e2f-b0fa-d3ed6339c11f', 'volume_name': 'volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057e3504-0629-48da-8863-667a5204cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057e3504-0629-48da-8863-667a5204cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5f51d0-1edc-43c5-b2bd-b1610374ef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume df42e7af-b9de-4e2f-b0fa-d3ed6339c11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f', 'volume_size': 1} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1077316388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df42e7af-b9de-4e2f-b0fa-d3ed6339c11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:21Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating volume df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:21 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f 1073741824 Sep 01 02:09:21 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f 1073741824" returned: 0 in 0.493s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f Sep 01 02:09:21 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:22 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5f51d0-1edc-43c5-b2bd-b1610374ef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b954a73-4aeb-4f21-a09d-33d9384a145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f (df42e7af-b9de-4e2f-b0fa-d3ed6339c11f): created successfully Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b954a73-4aeb-4f21-a09d-33d9384a145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (866b042e-58db-4572-8beb-3ef39878c437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ed5de1dc-0cca-4234-b51a-24b03b036fc0 tempest-VolumesSnapshotTestJSON-1581562884 None] Created volume successfully. Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Flow 'volume_create_manager' (361d197b-b2b8-4b1c-80a9-7d78acb89172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd8d9e-4218-41f4-be9b-c40a37e6d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd8d9e-4218-41f4-be9b-c40a37e6d38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-921958891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ef901d-eb0b-43b9-9867-10ab86a1f7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d73744c79a640d38ab77cff200f6cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:22Z,use_quota=True,user_id='1cd5d838af0344e28a8f47ecd731ce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b689941-0be9-4464-a3f1-75adffe98716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b689941-0be9-4464-a3f1-75adffe98716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0d3d3a-5779-4610-ab8e-2a5db8516570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0d3d3a-5779-4610-ab8e-2a5db8516570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82ef901d-eb0b-43b9-9867-10ab86a1f7e3', 'volume_name': 'volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620d0db1-47bc-4965-8bd2-aa89708ed9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620d0db1-47bc-4965-8bd2-aa89708ed9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d360e0-6ad6-43ef-b593-d511acfbafa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:09:22 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Trying to clone 82ef901d-eb0b-43b9-9867-10ab86a1f7e3 from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:09:23 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[94551409-e7b7-429d-963a-5b2b406a28ee]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD Sep 01 02:09:23 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 is fetched for user 1cd5d838af0344e28a8f47ecd731ce08. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da0b22-fc21-4503-ba95-0f9685889e16]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Creating offline snapshot 1a80a2a2-5f9e-48fa-9f70-0094eb72642c of volume df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8023c2a4-ccd1-4e39-9e6e-463ddb33339a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD Sep 01 02:09:23 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f Sep 01 02:09:23 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:24 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" returned: 0 in 0.424s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c 1G Sep 01 02:09:24 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c 1G" returned: 0 in 0.404s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c Sep 01 02:09:24 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c is being set with open permissions: ugo+rw Sep 01 02:09:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c Sep 01 02:09:24 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info Sep 01 02:09:25 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info is being set with open permissions: ugo+rw Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info Sep 01 02:09:25 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.info" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-921958891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ef901d-eb0b-43b9-9867-10ab86a1f7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d73744c79a640d38ab77cff200f6cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:22Z,use_quota=True,user_id='1cd5d838af0344e28a8f47ecd731ce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Creating volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:25 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1073741824 Sep 01 02:09:25 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-df57abcc-02b5-4485-96a8-faeba8c1709a tempest-VolumesSnapshotTestJSON-1581562884 None] Create snapshot completed successfully Sep 01 02:09:26 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1073741824" returned: 0 in 0.451s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 Sep 01 02:09:26 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Attempting download of 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060484e-4bfc-48fc-b002-5bbc57eba7d6]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq Sep 01 02:09:26 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq" returned: 0 in 0.357s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-1a80a2a2-5f9e-48fa-9f70-0094eb72642c-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-1a80a2a2-5f9e-48fa-9f70-0094eb72642c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:26 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq Sep 01 02:09:26 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-1a80a2a2-5f9e-48fa-9f70-0094eb72642c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-1a80a2a2-5f9e-48fa-9f70-0094eb72642c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Deleting offline snapshot 1a80a2a2-5f9e-48fa-9f70-0094eb72642c of volume df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] snapshot_file for this snap is: volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d5c38-ea79-4217-8bba-b2afe2ed50dc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c Sep 01 02:09:27 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq" returned: 1 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_zg42ourq' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc40f3-b710-4b2a-9db9-9f6872fe1058]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD Sep 01 02:09:27 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c" returned: 0 in 0.377s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ecf61f-bd3f-48eb-94c5-88b3f9c0f96e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] 514cc436-eb47-42bc-a3be-d669f2c6dfb1 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 Sep 01 02:09:27 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f Sep 01 02:09:27 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" returned: 0 in 0.355s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c Sep 01 02:09:27 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c" returned: 0 in 0.336s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c Sep 01 02:09:28 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f.1a80a2a2-5f9e-48fa-9f70-0094eb72642c" returned: 0 in 0.283s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-1a80a2a2-5f9e-48fa-9f70-0094eb72642c" released by "_delete_snapshot" :: held 1.469s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" released by "delete_snapshot" :: held 1.494s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['e18ab0f1-062e-46f8-8c60-61ea6107bc54', 'a4937c98-8c92-4373-b7ac-d5f0f147e253', '8c7ce16f-be25-457b-8137-c367a5d7510e', '7483302f-ba1f-449e-8e92-0ef8a19d08f2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Delete snapshot completed successfully. Sep 01 02:09:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ff878970-9fc2-4886-bb26-0b0ef206a840 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-1a80a2a2-5f9e-48fa-9f70-0094eb72642c-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:29 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" returned: 0 in 1.680s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_eul0x_d_devstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:29 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Converted 112.00 MB image at 66.65 MB/s Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1G Sep 01 02:09:29 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 1G" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Downloaded image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 for user 1cd5d838af0344e28a8f47ecd731ce08 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Marking volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Copying metadata from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 to 82ef901d-eb0b-43b9-9867-10ab86a1f7e3. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Creating volume glance metadata for volume 82ef901d-eb0b-43b9-9867-10ab86a1f7e3 backed by image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (2ebbbcfb-a8aa-4589-8064-47e0d0ab7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3b73da-60ed-4c4b-ae43-f6ef019e17a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3b73da-60ed-4c4b-ae43-f6ef019e17a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255656465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63616f3a-c9af-47e8-8b20-445f8af5beb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:30Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b6fae-e80b-4294-aac1-ad1c5db26fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b6fae-e80b-4294-aac1-ad1c5db26fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e0645-8e2b-47d3-a5a2-39ba6b126f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e0645-8e2b-47d3-a5a2-39ba6b126f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63616f3a-c9af-47e8-8b20-445f8af5beb0', 'volume_name': 'volume-63616f3a-c9af-47e8-8b20-445f8af5beb0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93cb3bc-bfdb-421d-8ad1-0566ee9f83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93cb3bc-bfdb-421d-8ad1-0566ee9f83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70730bdf-4863-4d71-ad5a-c6cd0e2b9a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume 63616f3a-c9af-47e8-8b20-445f8af5beb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63616f3a-c9af-47e8-8b20-445f8af5beb0', 'volume_size': 1} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255656465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63616f3a-c9af-47e8-8b20-445f8af5beb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:30Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating volume 63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:29 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 1073741824 Sep 01 02:09:29 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d360e0-6ad6-43ef-b593-d511acfbafa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def18743-c354-49b5-b5c6-553d124e481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Volume volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 (82ef901d-eb0b-43b9-9867-10ab86a1f7e3): created successfully Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def18743-c354-49b5-b5c6-553d124e481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Flow 'volume_create_manager' (361d197b-b2b8-4b1c-80a9-7d78acb89172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c27d291b-8aaa-4a7d-a89e-4b1b43b026aa tempest-VolumesImageMetadata-996888467 None] Created volume successfully. Sep 01 02:09:30 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 1073741824" returned: 0 in 0.441s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:30 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70730bdf-4863-4d71-ad5a-c6cd0e2b9a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63616f3a-c9af-47e8-8b20-445f8af5beb0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfbd1f1-c4e2-4309-9fec-115c1fd54596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 (63616f3a-c9af-47e8-8b20-445f8af5beb0): created successfully Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfbd1f1-c4e2-4309-9fec-115c1fd54596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (2ebbbcfb-a8aa-4589-8064-47e0d0ab7893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b45e8e4b-3027-47fa-92cf-98dac52b6447 tempest-VolumesSnapshotTestJSON-1581562884 None] Created volume successfully. Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating offline snapshot c5b3a513-e994-4aee-a062-4fb8c17bb42d of volume 63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ba4fb-3040-43b1-b42c-f06e6f86af9e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:31 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Acquiring lock "cinder-82ef901d-eb0b-43b9-9867-10ab86a1f7e3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "cinder-82ef901d-eb0b-43b9-9867-10ab86a1f7e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Acquiring lock "cinder-quobyte-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "cinder-quobyte-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d 1G Sep 01 02:09:31 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b8762b-ecde-4bb2-821e-c532c6db5534]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 Sep 01 02:09:31 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d 1G" returned: 0 in 0.464s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3 Sep 01 02:09:31 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:31 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "cinder-quobyte-82ef901d-eb0b-43b9-9867-10ab86a1f7e3" released by "delete_volume" :: held 0.710s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Created reservations ['f8887f6f-5a20-478d-bfcb-e58e514eab7c', 'addc8816-8c9b-4966-a035-9d92a3f64f8c', 'ed569dd7-f593-4fd9-8c4d-d192cecdbb48', '2bb7a9f5-692a-4d03-ab60-0881247e6847'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:32 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.316s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d is being set with open permissions: ugo+rw Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:32 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:32 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.266s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info Sep 01 02:09:32 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.274s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Deleted volume successfully. Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-75b17ab5-0a88-4691-8934-15dda7743bcb tempest-VolumesImageMetadata-996888467 None] Lock "cinder-82ef901d-eb0b-43b9-9867-10ab86a1f7e3-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info" returned: 0 in 0.305s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info is being set with open permissions: ugo+rw Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info Sep 01 02:09:32 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.info" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f7077ceb-ff36-4b5c-93ec-261404a06634 tempest-VolumesSnapshotTestJSON-1581562884 None] Create snapshot completed successfully Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (7a00c8c6-70ff-4922-86a4-e13c4f78374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5409a155-af49-4661-93f5-0ccdcabc9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5409a155-af49-4661-93f5-0ccdcabc9a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1152175150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bb5544-678e-4c45-a199-fc05fea6adb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c5b3a513-e994-4aee-a062-4fb8c17bb42d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:34Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1900a1bc-d791-4553-a3c9-23b49682bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1900a1bc-d791-4553-a3c9-23b49682bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aeab5e-d222-4ffe-8c25-37824a0d7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aeab5e-d222-4ffe-8c25-37824a0d7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54bb5544-678e-4c45-a199-fc05fea6adb3', 'volume_name': 'volume-54bb5544-678e-4c45-a199-fc05fea6adb3', 'volume_size': 2, 'snapshot_id': 'c5b3a513-e994-4aee-a062-4fb8c17bb42d'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecbe70-8e12-4092-aefc-dac0ffd74700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecbe70-8e12-4092-aefc-dac0ffd74700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0aa84b-1f12-40c2-96af-8d1e3544502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume 54bb5544-678e-4c45-a199-fc05fea6adb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54bb5544-678e-4c45-a199-fc05fea6adb3', 'volume_size': 2, 'snapshot_id': 'c5b3a513-e994-4aee-a062-4fb8c17bb42d'} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d-54bb5544-678e-4c45-a199-fc05fea6adb3" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d-54bb5544-678e-4c45-a199-fc05fea6adb3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating volume 54bb5544-678e-4c45-a199-fc05fea6adb3 from snapshot c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] snapshot: c5b3a513-e994-4aee-a062-4fb8c17bb42d, volume: 54bb5544-678e-4c45-a199-fc05fea6adb3, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e1cfd-edc4-44b7-9d91-013cb4998ec3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:34 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.365s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63616f3a-c9af-47e8-8b20-445f8af5beb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ef9623-6dc5-4976-a9c3-390c52447373]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:35 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 Sep 01 02:09:35 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Flow 'volume_create_manager' (4d413825-75b4-41e0-8f5e-3d85c55ffc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9fae5-d1fc-482c-b107-74f9be8b7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9fae5-d1fc-482c-b107-74f9be8b7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1435977370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a604837-4e30-415c-84b1-9ea97b4b7093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d29e22b7bac4ac19720c23653f877bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:37Z,use_quota=True,user_id='a115341d109140a1ad9fd1e84a3d8c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce433b36-f703-4ce8-8ade-4d06db980fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce433b36-f703-4ce8-8ade-4d06db980fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a75bc-6c51-4adb-a6d0-417f126a9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a75bc-6c51-4adb-a6d0-417f126a9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a604837-4e30-415c-84b1-9ea97b4b7093', 'volume_name': 'volume-6a604837-4e30-415c-84b1-9ea97b4b7093', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce33ae15-aa17-4f95-b2a2-7b41966ce523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce33ae15-aa17-4f95-b2a2-7b41966ce523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c03dc-8569-4bfc-932e-57a22f727005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Volume 6a604837-4e30-415c-84b1-9ea97b4b7093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a604837-4e30-415c-84b1-9ea97b4b7093', 'volume_size': 1} Sep 01 02:09:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:40 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3" returned: 0 in 5.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:40 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Converted 1024.00 MB image at 194.30 MB/s Sep 01 02:09:40 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 is being set with open permissions: ugo+rw Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 Sep 01 02:09:40 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:09:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:09:41 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" released by "_copy_volume_from_snapshot" :: held 6.469s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d-54bb5544-678e-4c45-a199-fc05fea6adb3" released by "_create_volume_from_snapshot" :: held 6.566s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.585s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1435977370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a604837-4e30-415c-84b1-9ea97b4b7093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d29e22b7bac4ac19720c23653f877bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:37Z,use_quota=True,user_id='a115341d109140a1ad9fd1e84a3d8c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Creating volume 6a604837-4e30-415c-84b1-9ea97b4b7093 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:41 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 1073741824 Sep 01 02:09:41 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0aa84b-1f12-40c2-96af-8d1e3544502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bb5544-678e-4c45-a199-fc05fea6adb3', 'volume_size': 2, 'snapshot_id': 'c5b3a513-e994-4aee-a062-4fb8c17bb42d'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31581df5-a36c-4af5-8da4-eb4b03b9acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume volume-54bb5544-678e-4c45-a199-fc05fea6adb3 (54bb5544-678e-4c45-a199-fc05fea6adb3): created successfully Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31581df5-a36c-4af5-8da4-eb4b03b9acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (7a00c8c6-70ff-4922-86a4-e13c4f78374f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b409ba44-bd5c-4a92-94e5-22b62871fb55 tempest-VolumesSnapshotTestJSON-1581562884 None] Created volume successfully. Sep 01 02:09:42 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 1073741824" returned: 0 in 0.850s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-567a5318-8e77-404c-854f-48b0f7089c6a req-c507524f-429e-4826-98ca-6b8216219778 tempest-ServerActionsTestOtherA-1734043553 None] Terminate volume connection completed successfully. Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-567a5318-8e77-404c-854f-48b0f7089c6a req-c507524f-429e-4826-98ca-6b8216219778 tempest-ServerActionsTestOtherA-1734043553 None] Deleting attachment 73637463-6aa0-4f28-859d-63207e1bcbfb. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 Sep 01 02:09:42 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "cinder-a66bd733-63d6-4e8e-b614-e84112a3ac38-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-a66bd733-63d6-4e8e-b614-e84112a3ac38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "cinder-quobyte-a66bd733-63d6-4e8e-b614-e84112a3ac38" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-quobyte-a66bd733-63d6-4e8e-b614-e84112a3ac38" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9851b16e-58af-4a2d-bac9-c7c36ccea21d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093" returned: 0 in 0.461s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c03dc-8569-4bfc-932e-57a22f727005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a604837-4e30-415c-84b1-9ea97b4b7093', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95253cbe-7f70-4f97-b7bd-ec8dc33c3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-54bb5544-678e-4c45-a199-fc05fea6adb3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Volume volume-6a604837-4e30-415c-84b1-9ea97b4b7093 (6a604837-4e30-415c-84b1-9ea97b4b7093): created successfully Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95253cbe-7f70-4f97-b7bd-ec8dc33c3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Flow 'volume_create_manager' (4d413825-75b4-41e0-8f5e-3d85c55ffc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-54bb5544-678e-4c45-a199-fc05fea6adb3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 Sep 01 02:09:42 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-68b36fc5-0492-4264-bb3c-238f50657ba2 tempest-AbsoluteLimitsTests-1843149029 None] Created volume successfully. Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" acquired by "delete_volume" :: waited 0.044s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[65483c8c-9683-4d7a-9122-09c127d9829e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 Sep 01 02:09:43 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38" returned: 0 in 0.682s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-16052323-0fa7-44eb-b197-c2485a1219f8 tempest-TestShelveInstance-646908429 None] Terminate volume connection completed successfully. Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-16052323-0fa7-44eb-b197-c2485a1219f8 tempest-TestShelveInstance-646908429 None] Deleting attachment 53131fdd-86f9-46dd-9944-c4c83d71d072. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:09:43 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38 Sep 01 02:09:43 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3" returned: 0 in 0.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3 Sep 01 02:09:43 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Acquiring lock "cinder-a6155bcf-c0ac-4275-9e5b-6289b4061483-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "cinder-a6155bcf-c0ac-4275-9e5b-6289b4061483-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:43 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Acquiring lock "cinder-quobyte-a6155bcf-c0ac-4275-9e5b-6289b4061483" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a66bd733-63d6-4e8e-b614-e84112a3ac38" returned: 0 in 0.347s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-quobyte-a66bd733-63d6-4e8e-b614-e84112a3ac38" released by "delete_volume" :: held 1.115s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "cinder-quobyte-a6155bcf-c0ac-4275-9e5b-6289b4061483" acquired by "delete_volume" :: waited 0.049s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Acquiring lock "cinder-6a604837-4e30-415c-84b1-9ea97b4b7093-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "cinder-6a604837-4e30-415c-84b1-9ea97b4b7093-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[77498a9b-a09c-4f34-b31f-44ce05d662b7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Acquiring lock "cinder-quobyte-6a604837-4e30-415c-84b1-9ea97b4b7093" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "cinder-quobyte-6a604837-4e30-415c-84b1-9ea97b4b7093" acquired by "delete_volume" :: waited 0.057s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-54bb5544-678e-4c45-a199-fc05fea6adb3" returned: 0 in 0.635s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 Sep 01 02:09:44 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc244f6-6ee8-4ba2-b0ad-1fa933625658]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.quota [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Created reservations ['7e108029-d58d-47fb-a6b6-9740f04e67f9', '4c42dd84-54b6-44c9-90bb-649bb17958c5', 'b69cb3de-c261-4e43-be2d-329ef4a86050', 'fa6c8812-0361-42d1-bea9-2ccf4ae0edc7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-54bb5544-678e-4c45-a199-fc05fea6adb3" released by "delete_volume" :: held 1.220s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "cinder-e14bfba7-09f4-4c59-b73d-cbca851aaad3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-e14bfba7-09f4-4c59-b73d-cbca851aaad3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "cinder-quobyte-e14bfba7-09f4-4c59-b73d-cbca851aaad3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:44 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-quobyte-e14bfba7-09f4-4c59-b73d-cbca851aaad3" acquired by "delete_volume" :: waited 0.048s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fea9da-683a-4542-9b3a-0f87774c5bcf]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['e7b05b99-fb85-4dd4-b3ca-c8b530c73e70', 'a1071e51-1792-4ef0-bff5-3cf26b4afd3c', 'fb8141d5-6a42-42fb-9104-6dc7c495487e', '64697d85-7131-443f-8eeb-d084a3de5a17'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:44 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:44 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 Sep 01 02:09:44 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:44 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483" returned: 0 in 0.876s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:44 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483 Sep 01 02:09:44 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.623s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.manager [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:45 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093" returned: 0 in 0.988s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Deleted volume successfully. Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3" returned: 0 in 0.677s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093 Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.501s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Deleted volume successfully. Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-567a5318-8e77-404c-854f-48b0f7089c6a req-68891012-18a2-4b4d-aad0-b6290122370a tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-a66bd733-63d6-4e8e-b614-e84112a3ac38-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3 Sep 01 02:09:45 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0aed7e87-932a-481f-bea0-38a02389e3df tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-54bb5544-678e-4c45-a199-fc05fea6adb3-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-c5b3a513-e994-4aee-a062-4fb8c17bb42d-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a6155bcf-c0ac-4275-9e5b-6289b4061483" returned: 0 in 0.622s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-c5b3a513-e994-4aee-a062-4fb8c17bb42d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "cinder-quobyte-a6155bcf-c0ac-4275-9e5b-6289b4061483" released by "delete_volume" :: held 1.660s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Deleting offline snapshot c5b3a513-e994-4aee-a062-4fb8c17bb42d of volume 63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] snapshot_file for this snap is: volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[850910a8-a799-4cac-aa76-be1ef601f936]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.quota [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Created reservations ['c58a425a-9294-46dc-80a8-d0bd8f70c4fc', 'ee688fa0-e990-4b53-8267-6861b9b6d747', 'f57367a3-c19d-44be-80a3-e11df194f054', '790147c4-0182-4812-99e7-1a01df89541b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:45 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e14bfba7-09f4-4c59-b73d-cbca851aaad3" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6a604837-4e30-415c-84b1-9ea97b4b7093" returned: 0 in 0.506s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-quobyte-e14bfba7-09f4-4c59-b73d-cbca851aaad3" released by "delete_volume" :: held 1.222s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "cinder-quobyte-6a604837-4e30-415c-84b1-9ea97b4b7093" released by "delete_volume" :: held 1.596s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:45 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Created reservations ['b6f14aad-d75e-48fa-92f3-261ab505184d', '0b87e046-7aa0-4105-9ba2-ac06e89839d4', '41597d2b-b7e8-427b-84dd-3d537d90b57c', 'f264b5f6-d8cf-4a04-9902-70d339f2fe1d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Created reservations ['adb36478-d29e-4254-8d3e-3fe83593e014', 'b784a319-d220-4ca8-b8f4-dc220dbda856', '152db71f-d3a6-48cd-9f89-af473a1bb562', '71cc9e72-2088-4746-98e2-0f069a951780'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:45 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.325s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.manager [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:45 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.563s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63616f3a-c9af-47e8-8b20-445f8af5beb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f196e0d-d4dd-45c6-9bcf-f2f4ec0ba1a9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Deleted volume successfully. Sep 01 02:09:46 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:46 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [req-40a80612-c6bb-4a21-8e28-76bc3a8567b1 req-d2faad67-2e22-45ac-b387-75e34a536e7c tempest-TestShelveInstance-646908429 None] Lock "cinder-a6155bcf-c0ac-4275-9e5b-6289b4061483-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:46 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:46 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.442s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Deleted volume successfully. Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-997c7ec0-8aca-4f5a-bb34-1aebca4d568b tempest-ServerActionsTestOtherA-1734043553 None] Lock "cinder-e14bfba7-09f4-4c59-b73d-cbca851aaad3-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:46 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Deleted volume successfully. Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4cc81485-094a-48fd-b22a-41a1f580a342 tempest-AbsoluteLimitsTests-1843149029 None] Lock "cinder-6a604837-4e30-415c-84b1-9ea97b4b7093-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:46 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.756s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:46 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.591s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d Sep 01 02:09:47 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0.c5b3a513-e994-4aee-a062-4fb8c17bb42d" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-c5b3a513-e994-4aee-a062-4fb8c17bb42d" released by "_delete_snapshot" :: held 2.431s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" released by "delete_snapshot" :: held 2.475s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['3fdacbbe-d352-4917-ad50-169a68557e30', 'b041728d-aad5-42db-b59d-e8b17c9f3bc3', 'c4d823fe-d506-42ae-a49f-7859153fd7de', '16b7094d-4ba0-4097-8434-f086e80937cc'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Delete snapshot completed successfully. Sep 01 02:09:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c6534f1-a819-4626-b364-f4a40f255911 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-c5b3a513-e994-4aee-a062-4fb8c17bb42d-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-63616f3a-c9af-47e8-8b20-445f8af5beb0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-63616f3a-c9af-47e8-8b20-445f8af5beb0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c4249-1c48-4297-baf8-6e7020b78e26]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:48 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.483s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0 Sep 01 02:09:49 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-63616f3a-c9af-47e8-8b20-445f8af5beb0" returned: 0 in 0.311s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-63616f3a-c9af-47e8-8b20-445f8af5beb0" released by "delete_volume" :: held 0.885s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['75fc5fa8-3a4d-466e-bb34-a518844b666d', '399bdffb-96cd-4dde-85f8-5c95f7bb5751', '3e986a8c-7d5c-41f7-810c-2fa694cd18a7', '5ccde707-f3c6-4d4e-b4af-96a3ad2c8c0f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:49 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.360s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Deleted volume successfully. Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92332f31-87d0-4e60-ae99-e06f520b85bb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-63616f3a-c9af-47e8-8b20-445f8af5beb0-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (b450ddf2-25e5-4d9e-9901-1b330e7de089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f739b-3a8c-4eb3-a44e-45fb38789bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f739b-3a8c-4eb3-a44e-45fb38789bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1021491195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa391f5d-dba8-4c97-94a4-5b590e5b9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:50Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faafcfa7-488e-49af-aea5-6a4f5e9ca021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faafcfa7-488e-49af-aea5-6a4f5e9ca021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48485f5-f706-4020-977a-d576e36bb704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48485f5-f706-4020-977a-d576e36bb704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa391f5d-dba8-4c97-94a4-5b590e5b9232', 'volume_name': 'volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345bf07d-e3d2-4991-81aa-0d98baac008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345bf07d-e3d2-4991-81aa-0d98baac008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463c2991-47dc-4b4d-bbc4-be5365fe8006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume aa391f5d-dba8-4c97-94a4-5b590e5b9232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232', 'volume_size': 1} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1021491195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa391f5d-dba8-4c97-94a4-5b590e5b9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:50Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating volume aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:50 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 1073741824 Sep 01 02:09:50 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:51 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 1073741824" returned: 0 in 0.673s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:51 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:09:51 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:51 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.345s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463c2991-47dc-4b4d-bbc4-be5365fe8006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6accd19b-550a-4fce-8a42-6c500ac5bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 (aa391f5d-dba8-4c97-94a4-5b590e5b9232): created successfully Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6accd19b-550a-4fce-8a42-6c500ac5bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (b450ddf2-25e5-4d9e-9901-1b330e7de089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-cfae2fc1-a173-4414-9806-302f0a2b1ce5 tempest-VolumesSnapshotTestJSON-1581562884 None] Created volume successfully. Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Flow 'volume_create_manager' (e96a1177-8833-447c-aba9-df4d469eff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361f15cc-ee44-4d7e-86c4-4a19ad3a9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361f15cc-ee44-4d7e-86c4-4a19ad3a9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1110656816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bf02ff-2bf7-480c-bed4-77cc07e78515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83de9356cb4d42e1ada057d83a46455e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:53Z,use_quota=True,user_id='d49094b322bc424aa82cc4d7b5750c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4259f-02d6-4184-80ce-5f7663422767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4259f-02d6-4184-80ce-5f7663422767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37586f3a-ee71-4ecd-b17f-9c4100f35302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37586f3a-ee71-4ecd-b17f-9c4100f35302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01bf02ff-2bf7-480c-bed4-77cc07e78515', 'volume_name': 'volume-01bf02ff-2bf7-480c-bed4-77cc07e78515', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b926d82-b84d-4917-9a56-f2c825da2d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b926d82-b84d-4917-9a56-f2c825da2d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d8b369-67d9-4c50-83d2-6e29a7c34aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Volume 01bf02ff-2bf7-480c-bed4-77cc07e78515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01bf02ff-2bf7-480c-bed4-77cc07e78515', 'volume_size': 1} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1110656816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bf02ff-2bf7-480c-bed4-77cc07e78515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83de9356cb4d42e1ada057d83a46455e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:53Z,use_quota=True,user_id='d49094b322bc424aa82cc4d7b5750c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Creating volume 01bf02ff-2bf7-480c-bed4-77cc07e78515 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:52 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 1073741824 Sep 01 02:09:52 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:53 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 1073741824" returned: 0 in 0.524s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 Sep 01 02:09:53 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515" returned: 0 in 0.333s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.827s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d8b369-67d9-4c50-83d2-6e29a7c34aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01bf02ff-2bf7-480c-bed4-77cc07e78515', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449cec33-df30-4c9c-bf97-583df69333fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Creating offline snapshot 0a03aa09-8347-46a6-8e08-1c81df2269b7 of volume aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Volume volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 (01bf02ff-2bf7-480c-bed4-77cc07e78515): created successfully Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449cec33-df30-4c9c-bf97-583df69333fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Flow 'volume_create_manager' (e96a1177-8833-447c-aba9-df4d469eff54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2804fff6-dde4-46a0-a593-8516dfa103c6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-25fe9f6c-5466-44c6-9219-c86f17ed4e71 tempest-VolumesMetadataTest-77986760 None] Created volume successfully. Sep 01 02:09:53 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:09:53 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.421s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:54 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 1G Sep 01 02:09:54 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 1G" returned: 0 in 0.599s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:54 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:09:54 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 is being set with open permissions: ugo+rw Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:09:55 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.266s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info Sep 01 02:09:55 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Acquiring lock "cinder-01bf02ff-2bf7-480c-bed4-77cc07e78515-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "cinder-01bf02ff-2bf7-480c-bed4-77cc07e78515-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Acquiring lock "cinder-quobyte-01bf02ff-2bf7-480c-bed4-77cc07e78515" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "cinder-quobyte-01bf02ff-2bf7-480c-bed4-77cc07e78515" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb1e33-7dc8-4b0c-af15-bcb33e338ef1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info is being set with open permissions: ugo+rw Sep 01 02:09:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 Sep 01 02:09:55 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info Sep 01 02:09:55 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.info" returned: 0 in 0.326s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:56 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515" returned: 0 in 0.480s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-563ab2f8-81e3-437e-8d4b-35012bbe9b6c tempest-VolumesSnapshotTestJSON-1581562884 None] Create snapshot completed successfully Sep 01 02:09:56 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515 Sep 01 02:09:56 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01bf02ff-2bf7-480c-bed4-77cc07e78515" returned: 0 in 0.281s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "cinder-quobyte-01bf02ff-2bf7-480c-bed4-77cc07e78515" released by "delete_volume" :: held 0.810s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Created reservations ['dcdd537f-7059-442d-8e26-1950032d21ae', '38d5c811-dfe4-4a1e-a3bc-e763f0789a17', '6690794b-7ae6-49ec-90be-2d0f858cd309', '07cc3de7-7b47-4041-b0a1-4910d6268945'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:09:56 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.348s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:57 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Deleted volume successfully. Sep 01 02:09:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e2e20152-b194-4d56-b868-077e9da42c96 tempest-VolumesMetadataTest-77986760 None] Lock "cinder-01bf02ff-2bf7-480c-bed4-77cc07e78515-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:57 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (dea732bc-9180-47ce-b724-c46d6db19c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fc608-f973-4966-86b1-b092a2a4f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fc608-f973-4966-86b1-b092a2a4f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-363836899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0066e2e8-bfef-4c57-9305-ed9e57e75e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9a7376e1b14f9b88e413d5516697da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a03aa09-8347-46a6-8e08-1c81df2269b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:58Z,use_quota=True,user_id='4c13c1501c1d41c19a593a47dd590408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49c9677-03e3-4a2b-b26d-3f2bbb825812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49c9677-03e3-4a2b-b26d-3f2bbb825812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e341fcc-e90b-48ed-81ad-19265f2d6e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e341fcc-e90b-48ed-81ad-19265f2d6e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0066e2e8-bfef-4c57-9305-ed9e57e75e00', 'volume_name': 'volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00', 'volume_size': 1, 'snapshot_id': '0a03aa09-8347-46a6-8e08-1c81df2269b7'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a135ad0-1fe8-417a-82ea-f428931a926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a135ad0-1fe8-417a-82ea-f428931a926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676bcf0d-021d-4dd6-8493-729bfd0caef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume 0066e2e8-bfef-4c57-9305-ed9e57e75e00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00', 'volume_size': 1, 'snapshot_id': '0a03aa09-8347-46a6-8e08-1c81df2269b7'} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7-0066e2e8-bfef-4c57-9305-ed9e57e75e00" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7-0066e2e8-bfef-4c57-9305-ed9e57e75e00" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating volume 0066e2e8-bfef-4c57-9305-ed9e57e75e00 from snapshot 0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] snapshot: 0a03aa09-8347-46a6-8e08-1c81df2269b7, volume: 0066e2e8-bfef-4c57-9305-ed9e57e75e00, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e143514-6a5a-45a0-8919-1552e3145aae]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:09:58 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.474s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67441a6-cde2-425a-9e7d-fc959e0ca752]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:09:58 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.426s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:59 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 Sep 01 02:09:59 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:04 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00" returned: 0 in 5.690s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:04 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:04 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Converted 1024.00 MB image at 179.92 MB/s Sep 01 02:10:04 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 is being set with open permissions: ugo+rw Sep 01 02:10:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:04 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 Sep 01 02:10:04 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:05 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00" returned: 0 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" released by "_copy_volume_from_snapshot" :: held 7.038s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7-0066e2e8-bfef-4c57-9305-ed9e57e75e00" released by "_create_volume_from_snapshot" :: held 7.134s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.160s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676bcf0d-021d-4dd6-8493-729bfd0caef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00', 'volume_size': 1, 'snapshot_id': '0a03aa09-8347-46a6-8e08-1c81df2269b7'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9031ac-3953-4064-89f7-8d524a4da0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Volume volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 (0066e2e8-bfef-4c57-9305-ed9e57e75e00): created successfully Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9031ac-3953-4064-89f7-8d524a4da0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Flow 'volume_create_manager' (dea732bc-9180-47ce-b724-c46d6db19c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d6f7a48a-6c9d-4a8f-8ebc-6e7de37e6641 tempest-VolumesSnapshotTestJSON-1581562884 None] Created volume successfully. Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-0066e2e8-bfef-4c57-9305-ed9e57e75e00-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-0066e2e8-bfef-4c57-9305-ed9e57e75e00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125cb58-c1b7-476f-b031-8ca5f9143aea]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 Sep 01 02:10:06 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Flow 'volume_create_manager' (eba02681-7b8f-4f77-8706-1d782bcf4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abe38b6-7202-42f1-bc13-665dc6f87a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abe38b6-7202-42f1-bc13-665dc6f87a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-41780610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38aa870-3b92-463b-bdfc-071c1e56b608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb4278dd6384467bfc898a2249bb31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:06Z,use_quota=True,user_id='4d7086965e1e43b0b080b8220680f8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059134df-d93b-4c04-99ce-8afb0e57f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059134df-d93b-4c04-99ce-8afb0e57f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0b3287-b875-4bab-a5d2-0df82625ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0b3287-b875-4bab-a5d2-0df82625ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38aa870-3b92-463b-bdfc-071c1e56b608', 'volume_name': 'volume-c38aa870-3b92-463b-bdfc-071c1e56b608', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0869cc-fa15-4ec4-979c-5512ea0583d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0869cc-fa15-4ec4-979c-5512ea0583d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feed89ba-7d32-4f8c-b6db-3df38eab3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Volume c38aa870-3b92-463b-bdfc-071c1e56b608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38aa870-3b92-463b-bdfc-071c1e56b608', 'volume_size': 1} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-41780610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38aa870-3b92-463b-bdfc-071c1e56b608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb4278dd6384467bfc898a2249bb31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:06Z,use_quota=True,user_id='4d7086965e1e43b0b080b8220680f8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Creating volume c38aa870-3b92-463b-bdfc-071c1e56b608 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:06 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 1073741824 Sep 01 02:10:06 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00" returned: 0 in 0.451s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00 Sep 01 02:10:06 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0066e2e8-bfef-4c57-9305-ed9e57e75e00" returned: 0 in 0.370s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0066e2e8-bfef-4c57-9305-ed9e57e75e00" released by "delete_volume" :: held 0.893s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['24ed153f-4d7f-4e2f-8263-169f6a3e5e7d', '9ed715d3-906d-4a70-a826-3f6b87141dfc', '18b695c9-d7be-4f3b-9918-3cd27a79cb5d', 'ad073f04-86d4-45b3-8f80-a02700a692e6'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:07 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 1073741824" returned: 0 in 0.663s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:07 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 Sep 01 02:10:07 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:07 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:07 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:07 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feed89ba-7d32-4f8c-b6db-3df38eab3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38aa870-3b92-463b-bdfc-071c1e56b608', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:07 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e45eec-c897-413d-ac47-2b3c9bf93741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.347s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Deleted volume successfully. Sep 01 02:10:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Volume volume-c38aa870-3b92-463b-bdfc-071c1e56b608 (c38aa870-3b92-463b-bdfc-071c1e56b608): created successfully Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e45eec-c897-413d-ac47-2b3c9bf93741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Flow 'volume_create_manager' (eba02681-7b8f-4f77-8706-1d782bcf4f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b0cbceb8-20e4-41c2-b6dc-3eea4e771625 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-0066e2e8-bfef-4c57-9305-ed9e57e75e00-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2d014c7a-4bdd-44eb-b0ee-9954a651a2d8 tempest-VolumesTransfersTest-762972019 None] Created volume successfully. Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-0a03aa09-8347-46a6-8e08-1c81df2269b7-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-0a03aa09-8347-46a6-8e08-1c81df2269b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Deleting offline snapshot 0a03aa09-8347-46a6-8e08-1c81df2269b7 of volume aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] snapshot_file for this snap is: volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc82e3b-76dc-4a0a-be51-a8881af1885a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:08 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:10:08 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:08 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.485s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5db552-14bc-4bc7-a2f6-250fed9398cf]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:09 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:10:09 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c12f9bd0-3e74-4290-a8eb-ff6e0da13d88 tempest-VolumesTransfersTest-548672427 None] Transfer volume completed successfully. Sep 01 02:10:09 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.682s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:09 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:10:09 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "cinder-c38aa870-3b92-463b-bdfc-071c1e56b608-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-c38aa870-3b92-463b-bdfc-071c1e56b608-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "cinder-quobyte-c38aa870-3b92-463b-bdfc-071c1e56b608" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-quobyte-c38aa870-3b92-463b-bdfc-071c1e56b608" acquired by "delete_volume" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b59f6-caef-4dae-b677-0abf6a045db3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:10 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.592s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:10 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7 Sep 01 02:10:10 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 Sep 01 02:10:10 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232.0a03aa09-8347-46a6-8e08-1c81df2269b7" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-0a03aa09-8347-46a6-8e08-1c81df2269b7" released by "_delete_snapshot" :: held 2.255s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" released by "delete_snapshot" :: held 2.289s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:10 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608" returned: 0 in 0.482s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:10 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608 Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['1a849ea9-5a3b-4ee1-a153-b7faeda7adbb', 'ddf95989-5211-4497-83fc-89216946eb07', '3825b763-f85e-4201-aa9e-a8e8d2e70b88', 'f589f3e7-d96b-4ff2-b66b-19c7a3062fe3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:10 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Delete snapshot completed successfully. Sep 01 02:10:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-28c1dc1e-e5c5-49a9-a61d-e889cab1baf0 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-0a03aa09-8347-46a6-8e08-1c81df2269b7-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:11 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c38aa870-3b92-463b-bdfc-071c1e56b608" returned: 0 in 0.348s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-quobyte-c38aa870-3b92-463b-bdfc-071c1e56b608" released by "delete_volume" :: held 0.880s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Created reservations ['7e289c74-acc2-40bb-b104-690920b562db', '0756cedd-9c2c-4506-9abb-66759665fd97', 'c863d23b-c9a0-4187-8096-0678ae2e3d0f', '6074575d-8b18-4994-aa5d-fc11adb3510d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:11 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:11 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:11 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Deleted volume successfully. Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-364852dc-ecdc-4b04-85b0-d12f0a68a9ff tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-c38aa870-3b92-463b-bdfc-071c1e56b608-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-aa391f5d-dba8-4c97-94a4-5b590e5b9232-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-aa391f5d-dba8-4c97-94a4-5b590e5b9232-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb99e00a-1f9c-4f84-bf5c-b9b10e21987d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Flow 'volume_create_manager' (87ca7add-4805-47d9-b2f6-6835971cc633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccfb165-1c45-4794-847e-bd3a5b9d7c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccfb165-1c45-4794-847e-bd3a5b9d7c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1060796198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f8acf-579f-4407-bfd1-c04568ba166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb4278dd6384467bfc898a2249bb31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:12Z,use_quota=True,user_id='4d7086965e1e43b0b080b8220680f8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5f71fc-1ef5-4ac8-82d9-dbf7ca1e3e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5f71fc-1ef5-4ac8-82d9-dbf7ca1e3e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:12 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:10:12 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c32f1-3359-4d3c-8bd4-92d1318014f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c32f1-3359-4d3c-8bd4-92d1318014f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128f8acf-579f-4407-bfd1-c04568ba166f', 'volume_name': 'volume-128f8acf-579f-4407-bfd1-c04568ba166f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23890ac2-9cb0-4841-9645-d11cd56dd53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23890ac2-9cb0-4841-9645-d11cd56dd53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0155d5-d107-4fa1-aad7-0f57adab36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Volume 128f8acf-579f-4407-bfd1-c04568ba166f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128f8acf-579f-4407-bfd1-c04568ba166f', 'volume_size': 1} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1060796198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f8acf-579f-4407-bfd1-c04568ba166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb4278dd6384467bfc898a2249bb31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:12Z,use_quota=True,user_id='4d7086965e1e43b0b080b8220680f8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Creating volume 128f8acf-579f-4407-bfd1-c04568ba166f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:12 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f 1073741824 Sep 01 02:10:12 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.483s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232 Sep 01 02:10:12 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-aa391f5d-dba8-4c97-94a4-5b590e5b9232" returned: 0 in 0.322s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f 1073741824" returned: 0 in 0.604s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-aa391f5d-dba8-4c97-94a4-5b590e5b9232" released by "delete_volume" :: held 0.924s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f Sep 01 02:10:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['f6194c11-a70a-453c-abb2-318b91c6f5df', '9000bc25-dc6c-4dc0-84ec-121a2715a2e9', '424adcd6-41b3-4685-8c57-1e8eca97ccbd', '802635ac-5222-4835-a0e1-c9f3aa58e866'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:12 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:13 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:13 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0155d5-d107-4fa1-aad7-0f57adab36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128f8acf-579f-4407-bfd1-c04568ba166f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ebbe5d-037a-4c77-9902-0684dc4da0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Volume volume-128f8acf-579f-4407-bfd1-c04568ba166f (128f8acf-579f-4407-bfd1-c04568ba166f): created successfully Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ebbe5d-037a-4c77-9902-0684dc4da0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Flow 'volume_create_manager' (87ca7add-4805-47d9-b2f6-6835971cc633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e40a9f3b-186d-4026-9920-57488d6a286f tempest-VolumesTransfersTest-762972019 None] Created volume successfully. Sep 01 02:10:13 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.324s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Deleted volume successfully. Sep 01 02:10:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-abbd6aab-2efb-4761-858f-e53ccbb31dfb tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-aa391f5d-dba8-4c97-94a4-5b590e5b9232-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad8f9d-c241-487d-a427-ca614ecba8c3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f Sep 01 02:10:14 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "cinder-128f8acf-579f-4407-bfd1-c04568ba166f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-128f8acf-579f-4407-bfd1-c04568ba166f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "cinder-quobyte-128f8acf-579f-4407-bfd1-c04568ba166f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-quobyte-128f8acf-579f-4407-bfd1-c04568ba166f" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ed5a2-f776-4c23-8881-b26352df1136]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" returned: 0 in 0.505s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f Sep 01 02:10:14 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f Sep 01 02:10:14 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:15 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" returned: 0 in 0.327s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-quobyte-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f" released by "delete_volume" :: held 0.927s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:15 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Created reservations ['7cf7b043-5d3c-4871-9d26-26bfa74f196d', 'af70da6c-1c76-4b03-b5b5-93f53662e7b1', '5d2e7632-d969-4c84-a9d8-04596753e58a', 'aea80ad0-d1a7-4fe0-b8be-ec92489b0ca7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:15 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f Sep 01 02:10:15 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:15 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:15 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-128f8acf-579f-4407-bfd1-c04568ba166f" returned: 0 in 0.365s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-quobyte-128f8acf-579f-4407-bfd1-c04568ba166f" released by "delete_volume" :: held 0.891s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Created reservations ['494e2375-8281-459c-abd4-27392a0fce2a', 'df68b70c-a878-486b-ad25-5615541b15a9', 'd5792a79-9d58-4e1a-8701-fc64169d09e5', '6cf6cbe4-4698-4ff0-a797-2e31c67af774'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:15 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.332s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Deleted volume successfully. Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-755ffde1-9fa2-4957-b5c1-a0dc9d8af0d9 tempest-VolumesSnapshotTestJSON-1581562884 None] Lock "cinder-df42e7af-b9de-4e2f-b0fa-d3ed6339c11f-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:15 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:16 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:16 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Deleted volume successfully. Sep 01 02:10:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f3d78260-e261-4b5a-b005-a5b45cd0d68b tempest-VolumesTransfersTest-1408614740 None] Lock "cinder-128f8acf-579f-4407-bfd1-c04568ba166f-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:25 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=139,cinder:UPDATE=163,cinder:INSERT=46,cinder:DELETE=8 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:26 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=123,cinder:UPDATE=151,cinder:INSERT=44,cinder:DELETE=18 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Flow 'volume_create_manager' (89f5d15d-90c6-49dc-b123-e60d83879702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25241d90-f0e6-4b10-92c8-cfb222290ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25241d90-f0e6-4b10-92c8-cfb222290ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1515024935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e03fb40-ab07-481e-9373-059070f3f6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c96cf8aaa1b4b3b8390f3110982bcf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:28Z,use_quota=True,user_id='54489ddf87e3412abd9b632835f616be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3732a1-c061-4d0b-b51f-9171444d82af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3732a1-c061-4d0b-b51f-9171444d82af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4267537-029b-4cc4-a102-506051d56282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4267537-029b-4cc4-a102-506051d56282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e03fb40-ab07-481e-9373-059070f3f6fe', 'volume_name': 'volume-5e03fb40-ab07-481e-9373-059070f3f6fe', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f13f79-2282-4506-8d3c-125bf5e7f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f13f79-2282-4506-8d3c-125bf5e7f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca1ba91-caab-4d76-813c-2a88cfaa595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Volume 5e03fb40-ab07-481e-9373-059070f3f6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e03fb40-ab07-481e-9373-059070f3f6fe', 'volume_size': 1} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1515024935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e03fb40-ab07-481e-9373-059070f3f6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c96cf8aaa1b4b3b8390f3110982bcf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:28Z,use_quota=True,user_id='54489ddf87e3412abd9b632835f616be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Creating volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:28 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe 1073741824 Sep 01 02:10:28 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe 1073741824" returned: 0 in 0.631s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe Sep 01 02:10:28 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:29 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca1ba91-caab-4d76-813c-2a88cfaa595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e03fb40-ab07-481e-9373-059070f3f6fe', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a297f-d668-4ff6-bef6-a4e6dfc47081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Volume volume-5e03fb40-ab07-481e-9373-059070f3f6fe (5e03fb40-ab07-481e-9373-059070f3f6fe): created successfully Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a297f-d668-4ff6-bef6-a4e6dfc47081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Flow 'volume_create_manager' (89f5d15d-90c6-49dc-b123-e60d83879702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8326f0c2-2318-46e7-91a2-b288cbfe5914 tempest-VolumesSnapshotListTestJSON-2085780382 None] Created volume successfully. Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Flow 'volume_create_manager' (3848aca2-6130-4147-b3ad-4c0f08a20cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68b3fa9-ce5c-4016-9f81-8cb434a52cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68b3fa9-ce5c-4016-9f81-8cb434a52cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-343240389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef578ed7-c7ff-4e3c-926e-7522b018f3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ba8ebdc45412bbd47d43fce640a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:29Z,use_quota=True,user_id='c521f8035466414b823bbf82d6efef6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac4ccb9-fea0-429c-aaac-0e61762ce89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac4ccb9-fea0-429c-aaac-0e61762ce89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4644b0f-acb1-406a-8be3-f56091a313d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4644b0f-acb1-406a-8be3-f56091a313d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef578ed7-c7ff-4e3c-926e-7522b018f3d4', 'volume_name': 'volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e1f25-54b3-4d1f-8919-3895ce7b936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e1f25-54b3-4d1f-8919-3895ce7b936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55011a16-86b7-47ef-860c-ec6c78cc9efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:10:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Trying to clone ef578ed7-c7ff-4e3c-926e-7522b018f3d4 from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:10:30 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3725b79-b22d-49e1-8254-7dbc25114fbc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD Sep 01 02:10:30 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Creating offline snapshot efdc05cb-e8d8-4b6a-8236-759a832976c0 of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc1831f-fa47-48fa-b20b-07bd0b4452b5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe Sep 01 02:10:30 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 is fetched for user c521f8035466414b823bbf82d6efef6f. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7036d-cc63-41be-93f1-e91288bbe7ed]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD Sep 01 02:10:31 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe" returned: 0 in 0.518s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 1G Sep 01 02:10:31 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:31 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 1G" returned: 0 in 0.663s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:31 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:32 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:32 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 is being set with open permissions: ugo+rw Sep 01 02:10:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:32 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:32 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:32 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.370s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:32 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info Sep 01 02:10:32 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:33 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info" returned: 0 in 0.312s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info is being set with open permissions: ugo+rw Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:33 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info Sep 01 02:10:33 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:33 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.info" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-343240389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef578ed7-c7ff-4e3c-926e-7522b018f3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ba8ebdc45412bbd47d43fce640a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:29Z,use_quota=True,user_id='c521f8035466414b823bbf82d6efef6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Creating volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:33 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:10:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ed9056d0-7b5e-4dc1-b536-5124f1dc2398 tempest-VolumesSnapshotListTestJSON-2085780382 None] Create snapshot completed successfully Sep 01 02:10:33 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1073741824 Sep 01 02:10:33 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:34 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1073741824" returned: 0 in 1.022s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:34 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 Sep 01 02:10:34 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:34 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" returned: 0 in 0.454s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.493s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Creating offline snapshot be010b5e-3a88-4b58-8330-835156b283fe of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:34 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Attempting download of 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7c5cd-eaa7-4e1c-bec2-8af95cce128b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf36f4a1-be2a-415c-b9c8-4ce4af469305]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:35 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:35 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we Sep 01 02:10:35 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:35 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.796s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:35 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe 1G Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we" returned: 0 in 0.786s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:36 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we Sep 01 02:10:36 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:36 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we" returned: 1 in 0.635s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_fka_v3we' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2231a5-189b-45e0-8d34-fd459ea83ba7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:36 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD Sep 01 02:10:36 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:36 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe 1G" returned: 0 in 0.966s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:36 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:36 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:37 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD" returned: 0 in 0.605s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:37 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] 514cc436-eb47-42bc-a3be-d669f2c6dfb1 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:10:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:37 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 Sep 01 02:10:37 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:37 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 0.686s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:37 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe is being set with open permissions: ugo+rw Sep 01 02:10:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:37 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:37 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:38 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 0.618s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d2980388-3fa6-4b44-ac02-cffd06f3aa98 tempest-VolumesSnapshotListTestJSON-2085780382 None] Create snapshot completed successfully Sep 01 02:10:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Creating offline snapshot 3c053afd-d291-4732-9fef-a76d4d1e6233 of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[16844385-6e55-4b53-b4b6-2ccb6640f147]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:39 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:39 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Flow 'volume_create_manager' (ee3edfc3-f2d4-46f9-b7e4-1cfcf8018a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466bb89-0cf0-477b-af49-b6786aa1b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466bb89-0cf0-477b-af49-b6786aa1b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-832886233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979f3ce-26f0-45ca-b2e6-4ecbae810cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b21fe8c3ec4072a2ab99376ddb0280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:40Z,use_quota=True,user_id='f74bc6bea24943f28287852ee02ea57e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:40 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0667a5-0094-46bd-ab4d-b2d1a91161ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:40 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0667a5-0094-46bd-ab4d-b2d1a91161ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b30c1de-d1c2-4ba5-8ce6-830bd5d9dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b30c1de-d1c2-4ba5-8ce6-830bd5d9dc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c979f3ce-26f0-45ca-b2e6-4ecbae810cfc', 'volume_name': 'volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12370ad6-cbc7-4e23-9bfe-1052c39592de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12370ad6-cbc7-4e23-9bfe-1052c39592de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724f87c3-f40a-4fc2-bf5b-08b7fb963fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Volume c979f3ce-26f0-45ca-b2e6-4ecbae810cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc', 'volume_size': 1} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" returned: 0 in 3.288s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 1.048s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_5lnbrjj6devstack@QuobyteHD, size 112.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:40 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Converted 112.00 MB image at 34.05 MB/s Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:40 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1G Sep 01 02:10:40 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:40 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 1G Sep 01 02:10:40 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:40 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:40 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 1G" returned: 0 in 0.620s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Downloaded image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 for user c521f8035466414b823bbf82d6efef6f is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Marking volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Copying metadata from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 to ef578ed7-c7ff-4e3c-926e-7522b018f3d4. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Creating volume glance metadata for volume ef578ed7-c7ff-4e3c-926e-7522b018f3d4 backed by image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:10:41 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:10:41 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 1G" returned: 0 in 0.876s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:41 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 Sep 01 02:10:41 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55011a16-86b7-47ef-860c-ec6c78cc9efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d02274-d187-4542-ac71-c483cacca86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Volume volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 (ef578ed7-c7ff-4e3c-926e-7522b018f3d4): created successfully Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d02274-d187-4542-ac71-c483cacca86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Flow 'volume_create_manager' (3848aca2-6130-4147-b3ad-4c0f08a20cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-76b35b05-f6d6-4465-afe7-4a9c0530e635 tempest-VolumesExtendTest-362810345 None] Created volume successfully. Sep 01 02:10:41 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 is being set with open permissions: ugo+rw Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:41 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 Sep 01 02:10:41 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-832886233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979f3ce-26f0-45ca-b2e6-4ecbae810cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b21fe8c3ec4072a2ab99376ddb0280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:40Z,use_quota=True,user_id='f74bc6bea24943f28287852ee02ea57e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Creating volume c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:42 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc 1073741824 Sep 01 02:10:42 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8ee29a8e-03e5-4de1-a906-f06750e22ae2 tempest-VolumesSnapshotListTestJSON-2085780382 None] Create snapshot completed successfully Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:42 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc 1073741824" returned: 0 in 0.519s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:10:42 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.296s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.784s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724f87c3-f40a-4fc2-bf5b-08b7fb963fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cbf247-b4d5-4cb1-8323-924a259cb1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2160c-7b7c-4526-8e0d-52153ba22568]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Volume volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc (c979f3ce-26f0-45ca-b2e6-4ecbae810cfc): created successfully Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cbf247-b4d5-4cb1-8323-924a259cb1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Flow 'volume_create_manager' (ee3edfc3-f2d4-46f9-b7e4-1cfcf8018a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3ae204a6-0b13-41da-90dd-3722d162d377 tempest-TestImageHashVerification-469040415 None] Created volume successfully. Sep 01 02:10:43 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 Sep 01 02:10:43 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 2G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-3c053afd-d291-4732-9fef-a76d4d1e6233-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-3c053afd-d291-4732-9fef-a76d4d1e6233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-3c053afd-d291-4732-9fef-a76d4d1e6233" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-3c053afd-d291-4732-9fef-a76d4d1e6233" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Deleting offline snapshot 3c053afd-d291-4732-9fef-a76d4d1e6233 of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] snapshot_file for this snap is: volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c11eba-a1c8-465a-a2d0-d27bbb583396]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 2G" returned: 0 in 0.186s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.671s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2923ad91-7740-43c5-8105-b053333f7839 tempest-VolumesExtendTest-362810345 None] Extend volume completed successfully. Sep 01 02:10:43 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 Sep 01 02:10:43 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233" returned: 0 in 0.403s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce7520-a9a9-4bc5-bf3b-c5efadcd98a6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:44 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 Sep 01 02:10:44 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4fbffb-b5aa-47de-a0ef-fe2d1b493062]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-ef578ed7-c7ff-4e3c-926e-7522b018f3d4-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "cinder-ef578ed7-c7ff-4e3c-926e-7522b018f3d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-quobyte-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:44 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:10:44 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e3088d-d670-44f6-99a6-f729972693c2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 Sep 01 02:10:44 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233" returned: 0 in 0.800s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.673s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233 Sep 01 02:10:45 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8515cf-d800-4548-a866-0994ac5f9424]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4 Sep 01 02:10:45 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:10:45 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.3c053afd-d291-4732-9fef-a76d4d1e6233" returned: 0 in 0.430s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-3c053afd-d291-4732-9fef-a76d4d1e6233" released by "_delete_snapshot" :: held 2.192s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" released by "delete_snapshot" :: held 2.222s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-ef578ed7-c7ff-4e3c-926e-7522b018f3d4" released by "delete_volume" :: held 0.929s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Created reservations ['e7dc5945-040f-48b7-a888-a2f0c09e1f80', 'c96b238c-1bfa-4905-b494-e7ac315a37c7', '31e61489-40b8-4ace-bbe4-dc3f5af9de47', 'd6191fcf-2cbe-41b3-a56a-28c59243a3e5'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:45 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Created reservations ['8d267c54-f8b2-4262-b71e-6cbf8399d28b', 'bb79a15c-8d75-4b38-be41-f28732c22fec', '637f078b-2219-4611-86b3-92dd4889257e', '739a985f-7c17-42d3-9fee-6e88b26ca69b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.553s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc /opt/stack/data/cinder/conversion/c979f3ce-26f0-45ca-b2e6-4ecbae810cfc.temp_image.c3b8120e-88e8-4e04-bc89-d9cd09b46a15n47nv47h.img {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc /opt/stack/data/cinder/conversion/c979f3ce-26f0-45ca-b2e6-4ecbae810cfc.temp_image.c3b8120e-88e8-4e04-bc89-d9cd09b46a15n47nv47h.img Sep 01 02:10:45 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:45 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Delete snapshot completed successfully. Sep 01 02:10:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9652d7ab-8647-4c54-a2d9-fc8ea1888b6b tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-3c053afd-d291-4732-9fef-a76d4d1e6233-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:46 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Deleted volume successfully. Sep 01 02:10:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-56cf36e1-0372-4a54-ba62-a1eaff155ee4 tempest-VolumesExtendTest-362810345 None] Lock "cinder-ef578ed7-c7ff-4e3c-926e-7522b018f3d4-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Flow 'volume_create_manager' (acb013a2-234e-4baf-863e-04fae50e6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2dae92-4e90-4a9d-a1a2-2663f0e15e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-be010b5e-3a88-4b58-8330-835156b283fe-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2dae92-4e90-4a9d-a1a2-2663f0e15e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1086873598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daffc072-fa65-41a8-993a-7ad5c915f47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ba8ebdc45412bbd47d43fce640a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:47Z,use_quota=True,user_id='c521f8035466414b823bbf82d6efef6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926187e7-e7d8-4ef2-a16c-7d5401808a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926187e7-e7d8-4ef2-a16c-7d5401808a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79eb74-77a5-4eaf-8c7b-7cc34b5bc6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79eb74-77a5-4eaf-8c7b-7cc34b5bc6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daffc072-fa65-41a8-993a-7ad5c915f47c', 'volume_name': 'volume-daffc072-fa65-41a8-993a-7ad5c915f47c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6693950-724b-4a35-bba9-79960fd47d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6693950-724b-4a35-bba9-79960fd47d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1179042c-5eea-4ba5-8dcb-edd004931b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:47 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Volume daffc072-fa65-41a8-993a-7ad5c915f47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daffc072-fa65-41a8-993a-7ad5c915f47c', 'volume_size': 1} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-be010b5e-3a88-4b58-8330-835156b283fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.170s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-be010b5e-3a88-4b58-8330-835156b283fe" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-be010b5e-3a88-4b58-8330-835156b283fe" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Deleting offline snapshot be010b5e-3a88-4b58-8330-835156b283fe of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] snapshot_file for this snap is: volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[958f33ec-c412-46ad-ab3d-51396e555fd2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:47 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:48 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 1.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be132e0-f94c-427c-b2af-4afbe2a7659d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:49 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:49 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:49 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.978s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:49 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:49 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:51 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 1.182s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:51 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe Sep 01 02:10:51 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:51 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc /opt/stack/data/cinder/conversion/c979f3ce-26f0-45ca-b2e6-4ecbae810cfc.temp_image.c3b8120e-88e8-4e04-bc89-d9cd09b46a15n47nv47h.img" returned: 0 in 5.225s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e61909-b37d-4223-a6cd-964a4a869299]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:51 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:10:51 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:51 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.be010b5e-3a88-4b58-8330-835156b283fe" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-be010b5e-3a88-4b58-8330-835156b283fe" released by "_delete_snapshot" :: held 3.867s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" released by "delete_snapshot" :: held 3.932s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:51 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.568s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/conversion/c979f3ce-26f0-45ca-b2e6-4ecbae810cfc.temp_image.c3b8120e-88e8-4e04-bc89-d9cd09b46a15n47nv47h.img {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:51 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Converted 1024.00 MB image at 195.91 MB/s Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] c3b8120e-88e8-4e04-bc89-d9cd09b46a15 was raw, no need to convert to raw {{(pid=86925) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Created reservations ['6e8e2f7b-c5cb-4bec-b447-184608e25c50', '9bca8cbf-64b7-45a3-aa07-dd48c1086f4f', '35e5981f-dfb1-4609-a366-d4078e8fcd26', '8d05d1f1-5fa8-4694-aa31-66aa9e92e96b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Delete snapshot completed successfully. Sep 01 02:10:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97901a50-9d8c-48d5-a542-43214d11ee90 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-be010b5e-3a88-4b58-8330-835156b283fe-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-efdc05cb-e8d8-4b6a-8236-759a832976c0-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-efdc05cb-e8d8-4b6a-8236-759a832976c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-efdc05cb-e8d8-4b6a-8236-759a832976c0" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-efdc05cb-e8d8-4b6a-8236-759a832976c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Deleting offline snapshot efdc05cb-e8d8-4b6a-8236-759a832976c0 of volume 5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] snapshot_file for this snap is: volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad976a-d809-4148-b16d-15d932d9f2d9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:52 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:52 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:52 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e03fb40-ab07-481e-9373-059070f3f6fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a3c62-2529-4554-a042-904811532229]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe Sep 01 02:10:53 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:53 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:53 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:53 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.386s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0 Sep 01 02:10:53 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:54 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe.efdc05cb-e8d8-4b6a-8236-759a832976c0" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-efdc05cb-e8d8-4b6a-8236-759a832976c0" released by "_delete_snapshot" :: held 1.512s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" released by "delete_snapshot" :: held 1.546s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Created reservations ['2b4a8411-2266-4e33-b4c1-a87a131a6a93', '8af0f1bd-deb9-4e32-b6ec-c6b4842c4426', '7eca42c7-3eae-4153-ae08-17b0963670b0', '414514f4-d3a4-4141-b869-63b9849f5f56'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Delete snapshot completed successfully. Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67e1b4cc-8643-4747-ac34-eb38d192dd14 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-efdc05cb-e8d8-4b6a-8236-759a832976c0-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-5e03fb40-ab07-481e-9373-059070f3f6fe-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-5e03fb40-ab07-481e-9373-059070f3f6fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4bced-41bb-4dc3-bfd6-80ea45dfe506]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:55 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe Sep 01 02:10:55 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:55 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe" returned: 0 in 0.473s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:55 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe Sep 01 02:10:55 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:55 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e03fb40-ab07-481e-9373-059070f3f6fe" returned: 0 in 0.281s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-quobyte-5e03fb40-ab07-481e-9373-059070f3f6fe" released by "delete_volume" :: held 0.839s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Created reservations ['7ed1b74d-b084-460b-b5a0-939b3c64bb86', '72878885-8628-41f8-a75c-2e579678a949', '95daefee-0df1-41a8-87be-273e22fc4856', '8a7f83e8-a6bc-4521-a5c6-07532c96edc9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:56 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:10:56 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:56 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.299s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:56 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Deleted volume successfully. Sep 01 02:10:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e3137b52-51d2-48aa-b659-c32f83492588 tempest-VolumesSnapshotListTestJSON-2085780382 None] Lock "cinder-5e03fb40-ab07-481e-9373-059070f3f6fe-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Flow 'volume_create_manager' (8d7db598-696b-48c1-bc05-d241ddfb6e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f9c828-3234-42e4-850e-6017e9c104a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f9c828-3234-42e4-850e-6017e9c104a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1341245944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf5c89c-1082-43ec-8462-dbc20330f980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a049497dee44978b7c762fea4fab6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='a8ac9b2bc855478d8dbcbc5fc9750338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6997525a-36d9-4780-b6ce-5cf68de2b5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6997525a-36d9-4780-b6ce-5cf68de2b5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dacf5c-84f3-4bb4-b2ed-41f13c0cdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dacf5c-84f3-4bb4-b2ed-41f13c0cdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf5c89c-1082-43ec-8462-dbc20330f980', 'volume_name': 'volume-9bf5c89c-1082-43ec-8462-dbc20330f980', 'volume_size': 2}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82124a3a-9825-4030-ab4a-ab1ded0da12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82124a3a-9825-4030-ab4a-ab1ded0da12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ffe3a-8da7-4158-97c3-75824fd2cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:59 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Volume 9bf5c89c-1082-43ec-8462-dbc20330f980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf5c89c-1082-43ec-8462-dbc20330f980', 'volume_size': 2} Sep 01 02:10:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (dc06adf2-68a0-4cb2-8e1e-115aaf0cd9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd08081-3426-4a56-b232-62571d834cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd08081-3426-4a56-b232-62571d834cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727254456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a1991f-cdef-4170-ad7e-2fa3ffb917ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:02Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8dd8a-f2c6-47b3-b8b4-830b112eb85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8dd8a-f2c6-47b3-b8b4-830b112eb85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4bd7ff-7602-46d7-ae6f-36cecc0af52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4bd7ff-7602-46d7-ae6f-36cecc0af52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a1991f-cdef-4170-ad7e-2fa3ffb917ff', 'volume_name': 'volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e51aa74-1da3-4055-aae0-c13d814ed2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e51aa74-1da3-4055-aae0-c13d814ed2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a7dff-00c4-4847-9b92-a2dbb97351d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Volume 04a1991f-cdef-4170-ad7e-2fa3ffb917ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff', 'volume_size': 1} Sep 01 02:11:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.962s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Uploaded volume to glance image-id: c3b8120e-88e8-4e04-bc89-d9cd09b46a15. {{(pid=86925) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.171s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1086873598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daffc072-fa65-41a8-993a-7ad5c915f47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ba8ebdc45412bbd47d43fce640a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:47Z,use_quota=True,user_id='c521f8035466414b823bbf82d6efef6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Creating volume daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:11 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:11 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c 1073741824 Sep 01 02:11:11 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3cedc7d7-4c2a-46a6-93ac-389f5027399a tempest-TestImageHashVerification-469040415 None] Copy volume to image completed successfully. Sep 01 02:11:11 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c 1073741824" returned: 0 in 0.472s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:12 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.397s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1341245944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf5c89c-1082-43ec-8462-dbc20330f980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a049497dee44978b7c762fea4fab6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='a8ac9b2bc855478d8dbcbc5fc9750338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Creating volume 9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:12 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 2147483648 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1179042c-5eea-4ba5-8dcb-edd004931b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daffc072-fa65-41a8-993a-7ad5c915f47c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0454682-688d-420d-9141-14deb12dfcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:12 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 2147483648 Sep 01 02:11:12 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Volume volume-daffc072-fa65-41a8-993a-7ad5c915f47c (daffc072-fa65-41a8-993a-7ad5c915f47c): created successfully Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0454682-688d-420d-9141-14deb12dfcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Flow 'volume_create_manager' (acb013a2-234e-4baf-863e-04fae50e6511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Acquiring lock "cinder-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8f7aff2c-37c1-4574-8f6e-6be21ceb0a9e tempest-VolumesExtendTest-362810345 None] Created volume successfully. Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "cinder-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Acquiring lock "cinder-quobyte-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "cinder-quobyte-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[08586612-2916-4bed-a0a2-397d068df0dc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:11:12 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 2147483648" returned: 0 in 0.507s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.373s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc Sep 01 02:11:12 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 Sep 01 02:11:12 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" returned: 0 in 0.259s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "cinder-quobyte-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc" released by "delete_volume" :: held 0.677s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:13 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.436s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727254456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a1991f-cdef-4170-ad7e-2fa3ffb917ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:02Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Creating volume 04a1991f-cdef-4170-ad7e-2fa3ffb917ff {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:13 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ffe3a-8da7-4158-97c3-75824fd2cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf5c89c-1082-43ec-8462-dbc20330f980', 'volume_size': 2}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff 1073741824 Sep 01 02:11:13 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad2114a-5b96-4737-9be5-26dd29dd1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Volume volume-9bf5c89c-1082-43ec-8462-dbc20330f980 (9bf5c89c-1082-43ec-8462-dbc20330f980): created successfully Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad2114a-5b96-4737-9be5-26dd29dd1500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Flow 'volume_create_manager' (8d7db598-696b-48c1-bc05-d241ddfb6e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8b7a4e5f-1759-4ec6-a3e6-e0ddfc91a356 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Created volume successfully. Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Created reservations ['d4ec7e13-cefe-4e12-a2bc-e0d5557e209c', '45856cd8-2766-4a79-9d79-8c99294471f8', 'f1febce2-4173-4a44-8c4c-9cd4ae1701cd', '4de5b0c6-cbfc-4e2a-9213-a6d28ee8fd2f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:11:13 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.282s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Deleted volume successfully. Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bb7c2f32-e646-44f0-8d77-b9f9e924d651 tempest-TestImageHashVerification-469040415 None] Lock "cinder-c979f3ce-26f0-45ca-b2e6-4ecbae810cfc-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:13 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff 1073741824" returned: 0 in 0.585s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff Sep 01 02:11:13 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:14 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" returned: 0 in 0.292s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.693s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a7dff-00c4-4847-9b92-a2dbb97351d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf3c94b-c9ba-4df0-810a-eef6e5131905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Creating offline snapshot fa1f7390-8731-446c-8ab1-a10fb5c61395 of volume daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ffa60b-53c8-41de-a297-15a008003233]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Volume volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff (04a1991f-cdef-4170-ad7e-2fa3ffb917ff): created successfully Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf3c94b-c9ba-4df0-810a-eef6e5131905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (dc06adf2-68a0-4cb2-8e1e-115aaf0cd9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d788cd83-9941-40fa-b44a-fcd9591ef099 tempest-AttachVolumeTestJSON-1522805662 None] Created volume successfully. Sep 01 02:11:14 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:14 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.447s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 1G Sep 01 02:11:14 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 1G" returned: 0 in 0.544s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daffc072-fa65-41a8-993a-7ad5c915f47c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daffc072-fa65-41a8-993a-7ad5c915f47c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 Sep 01 02:11:15 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bd17ce4d-2a37-4617-8da0-9daee8ea2049 req-07703418-48e8-4557-bb12-f70474e62499 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:15 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daffc072-fa65-41a8-993a-7ad5c915f47c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395" returned: 0 in 0.325s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 is being set with open permissions: ugo+rw Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 Sep 01 02:11:15 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info Sep 01 02:11:15 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info is being set with open permissions: ugo+rw Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info Sep 01 02:11:16 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.info" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.404s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Creating offline snapshot be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b of volume 9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-85c2b4c0-a68b-492f-8458-cc4116796161 tempest-VolumesExtendTest-362810345 None] Create snapshot completed successfully Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542a06a-50b7-4c49-8664-33582c669a95]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 Sep 01 02:11:16 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980" returned: 0 in 0.425s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b 2G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b 2G Sep 01 02:11:16 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b 2G" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf5c89c-1082-43ec-8462-dbc20330f980 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf5c89c-1082-43ec-8462-dbc20330f980 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b Sep 01 02:11:17 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf5c89c-1082-43ec-8462-dbc20330f980 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" returned: 0 in 0.325s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b is being set with open permissions: ugo+rw Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b Sep 01 02:11:17 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" returned: 0 in 0.293s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info Sep 01 02:11:17 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info is being set with open permissions: ugo+rw Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info Sep 01 02:11:18 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.info" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bd17ce4d-2a37-4617-8da0-9daee8ea2049 req-07703418-48e8-4557-bb12-f70474e62499 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.116s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-bd17ce4d-2a37-4617-8da0-9daee8ea2049 req-07703418-48e8-4557-bb12-f70474e62499 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.725s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8de65b1e-a203-4566-8c90-10c1e328e654 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Create snapshot completed successfully Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddaa2cb-4e53-43e7-ab35-b78c1d7ac459]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-bd17ce4d-2a37-4617-8da0-9daee8ea2049 req-07703418-48e8-4557-bb12-f70474e62499 tempest-AttachVolumeTestJSON-1522805662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc315743-e2e1-49dc-91b7-36c1553eca41', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:11:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-bd17ce4d-2a37-4617-8da0-9daee8ea2049 req-07703418-48e8-4557-bb12-f70474e62499 tempest-AttachVolumeTestJSON-1522805662 None] attachment_update completed successfully. Sep 01 02:11:18 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:18 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.482s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 2G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 2G" returned: 0 in 0.151s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.672s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6ed77da2-4261-41bd-9cc4-91701c27a732 tempest-VolumesExtendTest-362810345 None] Extend volume completed successfully. Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "cinder-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "cinder-quobyte-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Deleting offline snapshot be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b of volume 9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] snapshot_file for this snap is: volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bfe5a3-ff1a-473a-bcda-d1aea7a97c3c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:19 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b Sep 01 02:11:19 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:19 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" returned: 0 in 0.410s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bf5c89c-1082-43ec-8462-dbc20330f980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430cb5b-a247-4ccd-97b3-dd698b4f369d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-fa1f7390-8731-446c-8ab1-a10fb5c61395-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-fa1f7390-8731-446c-8ab1-a10fb5c61395-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:20 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 Sep 01 02:11:20 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-quobyte-fa1f7390-8731-446c-8ab1-a10fb5c61395" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-fa1f7390-8731-446c-8ab1-a10fb5c61395" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Deleting offline snapshot fa1f7390-8731-446c-8ab1-a10fb5c61395 of volume daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] snapshot_file for this snap is: volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c9b14-12a2-405d-bdac-93f17a0d601c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 Sep 01 02:11:20 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b Sep 01 02:11:20 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395" returned: 0 in 0.477s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daffc072-fa65-41a8-993a-7ad5c915f47c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec5ff2-a1fd-4ab9-aa77-c18aa623eaaf]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:20 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" returned: 0 in 0.530s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b Sep 01 02:11:20 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:21 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.501s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:21 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 Sep 01 02:11:21 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:21 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980.be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" returned: 0 in 0.332s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b" released by "_delete_snapshot" :: held 1.879s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" released by "delete_snapshot" :: held 1.906s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Created reservations ['788de475-acf3-463d-b544-c3563195fce8', '3f82b371-d062-4ff0-8579-d168c83671db', '406a9f68-a2e7-491d-87b8-d2339b6698ca', '7cfdf966-8c13-42ab-ad77-61d9e33c0ad2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Delete snapshot completed successfully. Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7f024e0d-f541-4e31-8e90-0158c59bd965 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-be0dd150-0a1c-45d1-9888-6ec0bf2ecf8b-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:21 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395" returned: 0 in 0.471s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "cinder-9bf5c89c-1082-43ec-8462-dbc20330f980-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:21 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395 Sep 01 02:11:21 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-9bf5c89c-1082-43ec-8462-dbc20330f980-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[77edb1d7-ebe5-44dd-b4e2-4a556f631f26]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:21 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 Sep 01 02:11:21 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:21 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c.fa1f7390-8731-446c-8ab1-a10fb5c61395" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-fa1f7390-8731-446c-8ab1-a10fb5c61395" released by "_delete_snapshot" :: held 1.920s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" released by "delete_snapshot" :: held 1.948s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Created reservations ['0bd77394-f2f1-45bc-a87d-22942fc90988', 'aacc4ce8-f0be-41f5-8876-8e4be10ad670', '99ed461f-c41d-4cc4-8ee3-2ba9d48085e2', '078c3ceb-247e-4a14-94be-72c44479cef4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Delete snapshot completed successfully. Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7270782f-678b-44ba-bad6-b4c5d73c1ed2 tempest-VolumesExtendTest-362810345 None] Lock "cinder-fa1f7390-8731-446c-8ab1-a10fb5c61395-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:22 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980" returned: 0 in 0.404s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:22 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980 Sep 01 02:11:22 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-daffc072-fa65-41a8-993a-7ad5c915f47c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "cinder-daffc072-fa65-41a8-993a-7ad5c915f47c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Acquiring lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f29bfa6-272a-4e7f-974b-39b0fcfe49fe]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:22 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9bf5c89c-1082-43ec-8462-dbc20330f980" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-quobyte-9bf5c89c-1082-43ec-8462-dbc20330f980" released by "delete_volume" :: held 0.860s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:22 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:22 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Created reservations ['b7ab1330-7504-444d-8ae0-ce41a35ab7ad', '71722018-a235-4594-9149-c47384147cd5', '2c60610c-66ab-4980-83d6-720c58de58e4', '88c6272a-1681-44a3-a853-344f9c1372f2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:11:23 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:23 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.646s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c Sep 01 02:11:23 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:23 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Deleted volume successfully. Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2e815cff-feaf-45ff-b070-da5ecf38a0b9 tempest-VolumesSnapshotNegativeTestJSON-1370565417 None] Lock "cinder-9bf5c89c-1082-43ec-8462-dbc20330f980-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:23 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-daffc072-fa65-41a8-993a-7ad5c915f47c" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "cinder-quobyte-daffc072-fa65-41a8-993a-7ad5c915f47c" released by "delete_volume" :: held 1.106s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Created reservations ['ad9ba7e8-3181-4ca7-8356-fe4de0638e4c', '828266fb-4fd7-467b-a26f-78695a55fd72', '1a5f012c-6fbe-46e5-a30b-c275e4cf8d33', '2fd70c2c-102a-439c-96d5-e50205091233'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:11:23 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:24 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:24 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Deleted volume successfully. Sep 01 02:11:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fda49cea-fb83-4194-aa5c-628b33cd6b36 tempest-VolumesExtendTest-362810345 None] Lock "cinder-daffc072-fa65-41a8-993a-7ad5c915f47c-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:33 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=103,cinder:SELECT=99,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:34 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=96,cinder:UPDATE=99,cinder:DELETE=10,cinder:INSERT=30 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Flow 'volume_create_manager' (89b454c8-4e36-49d8-bba3-54c256728c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d30840-c60d-4e1f-abf3-8e0c86436ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d30840-c60d-4e1f-abf3-8e0c86436ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991388be-2f26-4614-8fcd-9f4791b16f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aef89056c564f0794d4c4be21dac5a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:37Z,use_quota=True,user_id='3654a02dd94b4c87af9142314800e46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff54eab-1796-4af6-b5c3-299054cf9c75),volume_type_id=bff54eab-1796-4af6-b5c3-299054cf9c75)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c910ddb-22e3-4665-af82-1c185c3d7d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c910ddb-22e3-4665-af82-1c185c3d7d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd26c8-c705-43af-b56a-05aebbb28a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:36 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd26c8-c705-43af-b56a-05aebbb28a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '991388be-2f26-4614-8fcd-9f4791b16f51', 'volume_name': 'volume-991388be-2f26-4614-8fcd-9f4791b16f51', 'volume_size': 1, 'image_id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e1e52d6bb1ff0ffd159c23960972639', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aef89056c564f0794d4c4be21dac5a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb93def2d3b26227665171c5fdbef5acdb2daf4795f645b91ffefbca856b5f7b9752160f4175614a425bcf6cf110b38f2ea47cc9a39d4dc9b71742cf4a6a7552', 'id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/127288fa-2064-4196-924c-7b119ef2e6a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4f0fd7-6405-413f-8d7b-8b96436c572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4f0fd7-6405-413f-8d7b-8b96436c572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cda82-c9f4-4a3f-82e6-ac6cdd2ae778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Volume 991388be-2f26-4614-8fcd-9f4791b16f51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-991388be-2f26-4614-8fcd-9f4791b16f51', 'volume_size': 1, 'image_id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e1e52d6bb1ff0ffd159c23960972639', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aef89056c564f0794d4c4be21dac5a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb93def2d3b26227665171c5fdbef5acdb2daf4795f645b91ffefbca856b5f7b9752160f4175614a425bcf6cf110b38f2ea47cc9a39d4dc9b71742cf4a6a7552', 'id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/127288fa-2064-4196-924c-7b119ef2e6a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Trying to clone 991388be-2f26-4614-8fcd-9f4791b16f51 from image 127288fa-2064-4196-924c-7b119ef2e6a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:11:37 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3b857-3f60-40ac-85b6-980b46b9a27f]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:37 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:37 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:38 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:38 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:38 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:38 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 1 in 0.574s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Temporary image 127288fa-2064-4196-924c-7b119ef2e6a3 is fetched for user 3654a02dd94b4c87af9142314800e46e. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[65619f90-372a-4d45-958f-a2c72ab45e0c]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:39 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:39 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:39 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:39 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:39 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:39 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 1 in 0.539s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991388be-2f26-4614-8fcd-9f4791b16f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aef89056c564f0794d4c4be21dac5a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:37Z,use_quota=True,user_id='3654a02dd94b4c87af9142314800e46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff54eab-1796-4af6-b5c3-299054cf9c75),volume_type_id=bff54eab-1796-4af6-b5c3-299054cf9c75)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Creating volume 991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:39 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:11:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:39 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1073741824 Sep 01 02:11:39 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:40 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1073741824" returned: 0 in 0.713s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:40 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 Sep 01 02:11:40 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:40 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:11:40 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Attempting download of 127288fa-2064-4196-924c-7b119ef2e6a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}])) to volume 991388be-2f26-4614-8fcd-9f4791b16f51. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b4855-826a-4f19-8978-8bf8f3fff9e6]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:41 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.405s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:11:41 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb Sep 01 02:11:41 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:41 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb Sep 01 02:11:41 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:42 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb" returned: 1 in 0.452s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_127288fa-2064-4196-924c-7b119ef2e6a3_e2jea_gb' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a31091-ba36-4fc2-b8e2-41140fbb5e3c]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:42 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:42 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:42 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:42 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD Sep 01 02:11:42 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:42 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] 127288fa-2064-4196-924c-7b119ef2e6a3 was raw, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:11:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:42 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 Sep 01 02:11:42 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:43 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51" returned: 0 in 0.569s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_127288fa-2064-4196-924c-7b119ef2e6a3_a37dbo0idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:43 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:43 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1G Sep 01 02:11:43 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:43 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 1G" returned: 0 in 0.416s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Downloaded image 127288fa-2064-4196-924c-7b119ef2e6a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}])) to volume 991388be-2f26-4614-8fcd-9f4791b16f51 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Temporary image 127288fa-2064-4196-924c-7b119ef2e6a3 for user 3654a02dd94b4c87af9142314800e46e is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Marking volume 991388be-2f26-4614-8fcd-9f4791b16f51 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Copying metadata from image 127288fa-2064-4196-924c-7b119ef2e6a3 to 991388be-2f26-4614-8fcd-9f4791b16f51. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Creating volume glance metadata for volume 991388be-2f26-4614-8fcd-9f4791b16f51 backed by image 127288fa-2064-4196-924c-7b119ef2e6a3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4e1e52d6bb1ff0ffd159c23960972639', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cda82-c9f4-4a3f-82e6-ac6cdd2ae778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991388be-2f26-4614-8fcd-9f4791b16f51', 'volume_size': 1, 'image_id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/127288fa-2064-4196-924c-7b119ef2e6a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e1e52d6bb1ff0ffd159c23960972639', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2aef89056c564f0794d4c4be21dac5a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb93def2d3b26227665171c5fdbef5acdb2daf4795f645b91ffefbca856b5f7b9752160f4175614a425bcf6cf110b38f2ea47cc9a39d4dc9b71742cf4a6a7552', 'id': '127288fa-2064-4196-924c-7b119ef2e6a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/127288fa-2064-4196-924c-7b119ef2e6a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb76320-2a41-45db-aa49-a23a69552940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Volume volume-991388be-2f26-4614-8fcd-9f4791b16f51 (991388be-2f26-4614-8fcd-9f4791b16f51): created successfully Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb76320-2a41-45db-aa49-a23a69552940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Flow 'volume_create_manager' (89b454c8-4e36-49d8-bba3-54c256728c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-63f44cdf-02de-4f5a-88a0-49ca4ab15b0b tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Created volume successfully. Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Acquiring lock "cinder-991388be-2f26-4614-8fcd-9f4791b16f51-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "cinder-991388be-2f26-4614-8fcd-9f4791b16f51-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Acquiring lock "cinder-quobyte-991388be-2f26-4614-8fcd-9f4791b16f51" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "cinder-quobyte-991388be-2f26-4614-8fcd-9f4791b16f51" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e9139-f3b3-4ca6-9632-c05f789c1a83]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:44 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 Sep 01 02:11:44 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:44 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51" returned: 0 in 0.472s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:44 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51 Sep 01 02:11:44 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-991388be-2f26-4614-8fcd-9f4791b16f51" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "cinder-quobyte-991388be-2f26-4614-8fcd-9f4791b16f51" released by "delete_volume" :: held 0.919s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:45 devstack cinder-volume[86925]: WARNING cinder.quota [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:45 devstack cinder-volume[86925]: WARNING cinder.quota [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Created reservations ['ac87c6cb-aa69-437a-baf7-fedbd14094b5', '0ab9ff39-d0f7-4cb9-af88-de5d031f8299', '172f173d-9440-40d5-a36d-8e5f8dda3962', '42e2526c-694e-49d6-9844-1a8d5782cf80'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:11:45 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Deleted volume successfully. Sep 01 02:11:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-053b7c92-28ea-4bbe-9bcb-2d1a86e34da0 tempest-VolumeAndVolumeTypeFromImageTest-583308352 None] Lock "cinder-991388be-2f26-4614-8fcd-9f4791b16f51-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:55 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=15,cinder:SELECT=12,cinder:INSERT=9 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:55 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-fce6518c-efa8-45a5-82e0-9aa410c0dabf req-d2c45e86-5a9f-4793-9e69-7f7548bec986 tempest-AttachVolumeTestJSON-1522805662 None] Terminate volume connection completed successfully. Sep 01 02:11:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-fce6518c-efa8-45a5-82e0-9aa410c0dabf req-d2c45e86-5a9f-4793-9e69-7f7548bec986 tempest-AttachVolumeTestJSON-1522805662 None] Deleting attachment dc315743-e2e1-49dc-91b7-36c1553eca41. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Flow 'volume_create_manager' (d2e8f3cc-29ca-4926-9e34-532141a99e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d52972f-4de4-4e94-bcf8-2e5915d1bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d52972f-4de4-4e94-bcf8-2e5915d1bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c755e29d-9845-4b72-bb69-101663059efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbc9e988e25456dba5869a5ef9430a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='588d8244f59a42c39bcfcb9df54fdb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9abf630-9e11-4f8f-9506-173a284300d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9abf630-9e11-4f8f-9506-173a284300d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584812f8-0f81-4454-857c-5220a447505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584812f8-0f81-4454-857c-5220a447505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c755e29d-9845-4b72-bb69-101663059efa', 'volume_name': 'volume-c755e29d-9845-4b72-bb69-101663059efa', 'volume_size': 1, 'image_id': 'd9d3949a-0526-4469-841e-b3892d880609', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85b860d2332f8089230ccdeb26d1da45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ebbc9e988e25456dba5869a5ef9430a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cec3e1b61f7bffbd3376a878fa910433ff8905d79a6949858b7a951477c9c192e0042f446c8bbe78ce161df9f8e2e66f44276fa974ec9c6039045704ec1727f9', 'id': 'd9d3949a-0526-4469-841e-b3892d880609', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9d3949a-0526-4469-841e-b3892d880609/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a570fb3-5b69-4eb9-97d6-e1b88ee9912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a570fb3-5b69-4eb9-97d6-e1b88ee9912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd518-5157-48ec-9afe-b8f0f06a0ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Volume c755e29d-9845-4b72-bb69-101663059efa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c755e29d-9845-4b72-bb69-101663059efa', 'volume_size': 1, 'image_id': 'd9d3949a-0526-4469-841e-b3892d880609', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85b860d2332f8089230ccdeb26d1da45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ebbc9e988e25456dba5869a5ef9430a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cec3e1b61f7bffbd3376a878fa910433ff8905d79a6949858b7a951477c9c192e0042f446c8bbe78ce161df9f8e2e66f44276fa974ec9c6039045704ec1727f9', 'id': 'd9d3949a-0526-4469-841e-b3892d880609', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9d3949a-0526-4469-841e-b3892d880609/file', 'properties': {}}, 'image_service': } Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Trying to clone c755e29d-9845-4b72-bb69-101663059efa from image d9d3949a-0526-4469-841e-b3892d880609 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:12:06 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[12248655-f7a4-427d-bceb-3c70756246d8]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:06 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:07 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:07 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:07 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:07 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 1 in 0.618s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Temporary image d9d3949a-0526-4469-841e-b3892d880609 is fetched for user 588d8244f59a42c39bcfcb9df54fdb39. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2827e-67a0-4572-9753-b13bef756c87]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:08 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:08 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:09 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 1 in 0.684s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c755e29d-9845-4b72-bb69-101663059efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbc9e988e25456dba5869a5ef9430a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='588d8244f59a42c39bcfcb9df54fdb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Creating volume c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:09 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:12:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1073741824 Sep 01 02:12:09 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:10 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1073741824" returned: 0 in 1.094s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:10 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa Sep 01 02:12:10 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:11 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa" returned: 0 in 0.611s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Attempting download of d9d3949a-0526-4469-841e-b3892d880609 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}])) to volume c755e29d-9845-4b72-bb69-101663059efa. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7d294-643a-48a8-83bf-b7a406bf0646]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg Sep 01 02:12:11 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg" returned: 0 in 0.964s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg Sep 01 02:12:12 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg" returned: 1 in 0.557s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9d3949a-0526-4469-841e-b3892d880609_coeu1slg' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5702b26-f5e4-429f-b538-5faa26bc5d3a]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:12 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD Sep 01 02:12:13 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD" returned: 1 in 0.613s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] d9d3949a-0526-4469-841e-b3892d880609 was raw, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:12:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa Sep 01 02:12:14 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa" returned: 0 in 1.143s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d9d3949a-0526-4469-841e-b3892d880609_6275djnzdevstack@QuobyteHD, size 0.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:15 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1G Sep 01 02:12:15 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa 1G" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Downloaded image d9d3949a-0526-4469-841e-b3892d880609 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}])) to volume c755e29d-9845-4b72-bb69-101663059efa successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Temporary image d9d3949a-0526-4469-841e-b3892d880609 for user 588d8244f59a42c39bcfcb9df54fdb39 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Marking volume c755e29d-9845-4b72-bb69-101663059efa as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Copying metadata from image d9d3949a-0526-4469-841e-b3892d880609 to c755e29d-9845-4b72-bb69-101663059efa. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Creating volume glance metadata for volume c755e29d-9845-4b72-bb69-101663059efa backed by image d9d3949a-0526-4469-841e-b3892d880609 with: {'image_id': 'd9d3949a-0526-4469-841e-b3892d880609', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '85b860d2332f8089230ccdeb26d1da45', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd518-5157-48ec-9afe-b8f0f06a0ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c755e29d-9845-4b72-bb69-101663059efa', 'volume_size': 1, 'image_id': 'd9d3949a-0526-4469-841e-b3892d880609', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9d3949a-0526-4469-841e-b3892d880609', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85b860d2332f8089230ccdeb26d1da45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ebbc9e988e25456dba5869a5ef9430a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cec3e1b61f7bffbd3376a878fa910433ff8905d79a6949858b7a951477c9c192e0042f446c8bbe78ce161df9f8e2e66f44276fa974ec9c6039045704ec1727f9', 'id': 'd9d3949a-0526-4469-841e-b3892d880609', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9d3949a-0526-4469-841e-b3892d880609/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe4e0cf-bb56-4482-aef4-1a65e6081fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Volume volume-c755e29d-9845-4b72-bb69-101663059efa (c755e29d-9845-4b72-bb69-101663059efa): created successfully Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe4e0cf-bb56-4482-aef4-1a65e6081fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Flow 'volume_create_manager' (d2e8f3cc-29ca-4926-9e34-532141a99e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e2fd116e-0355-436a-af63-80a0475f59d0 tempest-VolumeImageDependencyTests-859700941 None] Created volume successfully. Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Flow 'volume_create_manager' (fe9c7a3d-240e-428c-8b36-ad8ecd0ac984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922517c3-b04f-4c7c-8871-ad183751e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922517c3-b04f-4c7c-8871-ad183751e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1345604435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543c40f7-c7af-4807-8035-5b4c5c7598f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d96ae8517446058a4f5db04ce9008d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:16Z,use_quota=True,user_id='3976ea206ae74d4d9bf1a6a9641e540f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fa3ece-e27f-4bfb-9148-262caf2a7397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fa3ece-e27f-4bfb-9148-262caf2a7397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a6db7c-a3df-4e2b-b430-5a3e63fa2743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a6db7c-a3df-4e2b-b430-5a3e63fa2743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543c40f7-c7af-4807-8035-5b4c5c7598f3', 'volume_name': 'volume-543c40f7-c7af-4807-8035-5b4c5c7598f3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccd704e-c129-43c3-9cd0-9297dddf8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccd704e-c129-43c3-9cd0-9297dddf8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75ab46-1698-4e8f-afca-2a45c8fdaf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:16 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Volume 543c40f7-c7af-4807-8035-5b4c5c7598f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543c40f7-c7af-4807-8035-5b4c5c7598f3', 'volume_size': 1} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1345604435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543c40f7-c7af-4807-8035-5b4c5c7598f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d96ae8517446058a4f5db04ce9008d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:16Z,use_quota=True,user_id='3976ea206ae74d4d9bf1a6a9641e540f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Creating volume 543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:16 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 1073741824 Sep 01 02:12:16 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 1073741824" returned: 0 in 0.593s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:16 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Acquiring lock "cinder-c755e29d-9845-4b72-bb69-101663059efa-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "cinder-c755e29d-9845-4b72-bb69-101663059efa-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Acquiring lock "cinder-quobyte-c755e29d-9845-4b72-bb69-101663059efa" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "cinder-quobyte-c755e29d-9845-4b72-bb69-101663059efa" acquired by "delete_volume" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7970b-c5e5-4fe7-8fcf-fabd06b84969]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa Sep 01 02:12:17 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.581s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75ab46-1698-4e8f-afca-2a45c8fdaf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543c40f7-c7af-4807-8035-5b4c5c7598f3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e77046-8d2a-48a1-a5e5-99fe7192ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Volume volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 (543c40f7-c7af-4807-8035-5b4c5c7598f3): created successfully Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e77046-8d2a-48a1-a5e5-99fe7192ce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Flow 'volume_create_manager' (fe9c7a3d-240e-428c-8b36-ad8ecd0ac984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-765d185b-f6ad-46cc-a487-45636495c287 tempest-SnapshotDependencyTests-1369186889 None] Created volume successfully. Sep 01 02:12:17 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa" returned: 0 in 0.547s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa Sep 01 02:12:17 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:18 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Flow 'volume_create_manager' (459b56f6-7c7c-452f-bfc7-aa9ab5b9ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c69827c-c441-4c82-9274-fc02c5a4b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c755e29d-9845-4b72-bb69-101663059efa" returned: 0 in 0.509s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c69827c-c441-4c82-9274-fc02c5a4b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1071080268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64274e3d-76d3-4691-aeb0-bc090a002c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d03f0ba4c740449a76365519318761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:18Z,use_quota=True,user_id='60b9967458eb478b86a5c0abcb6a9a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2af5db-463c-4f7d-be2a-7883d404101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2af5db-463c-4f7d-be2a-7883d404101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a513c3-7707-4ee3-94a9-ae27723af063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a513c3-7707-4ee3-94a9-ae27723af063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64274e3d-76d3-4691-aeb0-bc090a002c93', 'volume_name': 'volume-64274e3d-76d3-4691-aeb0-bc090a002c93', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1484303c-7291-497a-be38-6da1302aca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1484303c-7291-497a-be38-6da1302aca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dade2a1-325e-4864-82b2-3b5d01df6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Volume 64274e3d-76d3-4691-aeb0-bc090a002c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64274e3d-76d3-4691-aeb0-bc090a002c93', 'volume_size': 1} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1071080268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64274e3d-76d3-4691-aeb0-bc090a002c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d03f0ba4c740449a76365519318761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:18Z,use_quota=True,user_id='60b9967458eb478b86a5c0abcb6a9a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Creating volume 64274e3d-76d3-4691-aeb0-bc090a002c93 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "cinder-quobyte-c755e29d-9845-4b72-bb69-101663059efa" released by "delete_volume" :: held 1.203s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:18 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 1073741824 Sep 01 02:12:18 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Created reservations ['c0ef2ecf-f77a-47b0-b0bc-11530c632a84', 'd0128114-1af5-4cb5-b831-c69d6496754d', '7f7a869e-fac1-4f6d-9bbe-349801af8bd1', '264024b2-2040-473e-a10a-73ea0f31cba9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:18 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 1073741824" returned: 0 in 0.603s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Deleted volume successfully. Sep 01 02:12:18 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 Sep 01 02:12:18 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f10dca4b-7960-4b14-bf0d-04cac22c8ced tempest-VolumeImageDependencyTests-859700941 None] Lock "cinder-c755e29d-9845-4b72-bb69-101663059efa-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:19 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.635s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dade2a1-325e-4864-82b2-3b5d01df6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64274e3d-76d3-4691-aeb0-bc090a002c93', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1ed185-6132-48a9-9940-19fd8524c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Creating offline snapshot 0c803e95-16c2-4d50-afce-e0b59494ef47 of volume 543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Volume volume-64274e3d-76d3-4691-aeb0-bc090a002c93 (64274e3d-76d3-4691-aeb0-bc090a002c93): created successfully Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1ed185-6132-48a9-9940-19fd8524c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Flow 'volume_create_manager' (459b56f6-7c7c-452f-bfc7-aa9ab5b9ed35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a64efe-7102-48dc-8345-307be03fd277]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-006dcc3d-e5e6-43b6-9cf6-c2e46147040f tempest-TestMinimumBasicScenario-1327668380 None] Created volume successfully. Sep 01 02:12:19 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:19 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:19 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.513s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:19 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 1G Sep 01 02:12:19 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:20 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 1G" returned: 0 in 0.668s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:20 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.675s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 is being set with open permissions: ugo+rw Sep 01 02:12:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:21 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.434s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info Sep 01 02:12:21 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0a01ea54-9970-42a5-beeb-79545b671801 req-31bfb2b0-07d1-4f62-9fcb-292b0db7ded9 tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:22 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info" returned: 0 in 0.513s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:22 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info is being set with open permissions: ugo+rw Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:22 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info Sep 01 02:12:22 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:22 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.info" returned: 0 in 0.301s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0a01ea54-9970-42a5-beeb-79545b671801 req-31bfb2b0-07d1-4f62-9fcb-292b0db7ded9 tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.620s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-0a01ea54-9970-42a5-beeb-79545b671801 req-31bfb2b0-07d1-4f62-9fcb-292b0db7ded9 tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-36119f5d-df94-4b12-84c7-d82927eded10 tempest-SnapshotDependencyTests-1369186889 None] Create snapshot completed successfully Sep 01 02:12:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-0a01ea54-9970-42a5-beeb-79545b671801 req-31bfb2b0-07d1-4f62-9fcb-292b0db7ded9 tempest-TestMinimumBasicScenario-1327668380 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-64274e3d-76d3-4691-aeb0-bc090a002c93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4143265-d7d1-4411-971f-bc465b811b1f', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:12:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-0a01ea54-9970-42a5-beeb-79545b671801 req-31bfb2b0-07d1-4f62-9fcb-292b0db7ded9 tempest-TestMinimumBasicScenario-1327668380 None] attachment_update completed successfully. Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Flow 'volume_create_manager' (1a429720-bccf-4f10-9d61-b97f172551ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2efea7-e935-443e-a98a-04572831cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2efea7-e935-443e-a98a-04572831cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cabe0b-cca7-4211-b0e2-0a8d084a6aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d96ae8517446058a4f5db04ce9008d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c803e95-16c2-4d50-afce-e0b59494ef47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:24Z,use_quota=True,user_id='3976ea206ae74d4d9bf1a6a9641e540f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2a9e0-6e3e-4ce6-b5b6-37059d008e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2a9e0-6e3e-4ce6-b5b6-37059d008e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabec820-253f-41b8-86ba-2238a2adb806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabec820-253f-41b8-86ba-2238a2adb806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24cabe0b-cca7-4211-b0e2-0a8d084a6aba', 'volume_name': 'volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba', 'volume_size': 1, 'snapshot_id': '0c803e95-16c2-4d50-afce-e0b59494ef47'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5050e1-e674-4332-b6a4-da01c7d53ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5050e1-e674-4332-b6a4-da01c7d53ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8820fd2-e822-46d9-be56-be703245f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Volume 24cabe0b-cca7-4211-b0e2-0a8d084a6aba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba', 'volume_size': 1, 'snapshot_id': '0c803e95-16c2-4d50-afce-e0b59494ef47'} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Creating volume 24cabe0b-cca7-4211-b0e2-0a8d084a6aba from snapshot 0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] snapshot: 0c803e95-16c2-4d50-afce-e0b59494ef47, volume: 24cabe0b-cca7-4211-b0e2-0a8d084a6aba, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfada513-07de-4c17-89bb-5fed9e52ca01]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:24 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.384s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-543c40f7-c7af-4807-8035-5b4c5c7598f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839c183-2aa1-4c0d-85a1-6924fb3a1d7c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:24 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba Sep 01 02:12:25 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Flow 'volume_create_manager' (e16948d1-7eb5-408c-850c-dddb0d90a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2ea164-df85-4428-befc-8b1113c55383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2ea164-df85-4428-befc-8b1113c55383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107257227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5b8bc-d77a-4003-9ac9-e433924abbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbe2a819e3b4850aaf178edd408ba1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:26Z,use_quota=True,user_id='bb1c869cbf2247898dcf472cfe3744b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4098ef72-0133-48a8-b201-4cac839f7759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4098ef72-0133-48a8-b201-4cac839f7759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cdb0db-e9b7-4a4a-85b1-1f53c5bdd78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cdb0db-e9b7-4a4a-85b1-1f53c5bdd78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb5b8bc-d77a-4003-9ac9-e433924abbcc', 'volume_name': 'volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460ed8f4-3a5d-4bee-9ace-ab0df425d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460ed8f4-3a5d-4bee-9ace-ab0df425d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaefcd5-813c-4cb7-85ca-0db5c5b88b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:25 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Volume dcb5b8bc-d77a-4003-9ac9-e433924abbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc', 'volume_size': 1} Sep 01 02:12:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:31 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" returned: 0 in 6.137s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:31 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Converted 1024.00 MB image at 166.83 MB/s Sep 01 02:12:31 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba is being set with open permissions: ugo+rw Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba Sep 01 02:12:31 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" returned: 0 in 0.408s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" released by "_copy_volume_from_snapshot" :: held 7.435s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" released by "_create_volume_from_snapshot" :: held 7.519s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.539s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.026s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107257227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5b8bc-d77a-4003-9ac9-e433924abbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbe2a819e3b4850aaf178edd408ba1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:26Z,use_quota=True,user_id='bb1c869cbf2247898dcf472cfe3744b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Creating volume dcb5b8bc-d77a-4003-9ac9-e433924abbcc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:31 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc 1073741824 Sep 01 02:12:31 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8820fd2-e822-46d9-be56-be703245f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba', 'volume_size': 1, 'snapshot_id': '0c803e95-16c2-4d50-afce-e0b59494ef47'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcafc65-7e6f-48aa-ba0f-b276af96b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Volume volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba (24cabe0b-cca7-4211-b0e2-0a8d084a6aba): created successfully Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcafc65-7e6f-48aa-ba0f-b276af96b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Flow 'volume_create_manager' (1a429720-bccf-4f10-9d61-b97f172551ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4f6522bb-f721-40b3-9c05-597f3ecb728d tempest-SnapshotDependencyTests-1369186889 None] Created volume successfully. Sep 01 02:12:32 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc 1073741824" returned: 0 in 0.764s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc Sep 01 02:12:32 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaefcd5-813c-4cb7-85ca-0db5c5b88b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b653291e-055f-4c32-9ac9-fcb56050657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:32 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Volume volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc (dcb5b8bc-d77a-4003-9ac9-e433924abbcc): created successfully Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b653291e-055f-4c32-9ac9-fcb56050657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Flow 'volume_create_manager' (e16948d1-7eb5-408c-850c-dddb0d90a432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4d33340c-4768-4376-b9f5-043d1b8dd7c7 tempest-ProjectReaderTests-227148902 None] Created volume successfully. Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-0c803e95-16c2-4d50-afce-e0b59494ef47-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-0c803e95-16c2-4d50-afce-e0b59494ef47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Deleting offline snapshot 0c803e95-16c2-4d50-afce-e0b59494ef47 of volume 543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] snapshot_file for this snap is: volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[037ce7aa-a899-43dd-b9cf-3955f02662f1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:33 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.469s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-543c40f7-c7af-4807-8035-5b4c5c7598f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb052ed7-dc73-4eb3-bb12-e30fa0f6f02e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:34 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Acquiring lock "cinder-dcb5b8bc-d77a-4003-9ac9-e433924abbcc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "cinder-dcb5b8bc-d77a-4003-9ac9-e433924abbcc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Acquiring lock "cinder-quobyte-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "cinder-quobyte-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" acquired by "delete_volume" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f2ee17-2fdd-449b-aaea-1205f6b81ae3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc Sep 01 02:12:34 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.939s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:34 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" returned: 0 in 0.567s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc Sep 01 02:12:34 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.458s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47 Sep 01 02:12:35 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" returned: 0 in 0.448s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "cinder-quobyte-dcb5b8bc-d77a-4003-9ac9-e433924abbcc" released by "delete_volume" :: held 1.130s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Created reservations ['67fdcfff-74a0-47fd-b87c-20ddb3fcb7c2', 'cf0b7523-f155-4c94-b93a-92cd1ada7985', '497711d7-00c3-4774-a379-4674b2b22d76', '3913f4b3-ae2c-4f8a-a270-e62654757bca'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:35 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3.0c803e95-16c2-4d50-afce-e0b59494ef47" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-0c803e95-16c2-4d50-afce-e0b59494ef47" released by "_delete_snapshot" :: held 2.408s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" released by "delete_snapshot" :: held 2.446s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Created reservations ['b1efbefd-77b2-46ad-b3d0-5d044355385c', 'c6da3b75-1283-445a-90af-53990d7b2989', '78117e07-8353-4668-abb3-84b451aa8dc0', 'a0871623-1645-43c4-9e8f-1c218fae2042'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:35 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.327s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Deleted volume successfully. Sep 01 02:12:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Delete snapshot completed successfully. Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ed89cdb1-63db-4549-bba4-89224345ac25 tempest-ProjectReaderTests-227148902 None] Lock "cinder-dcb5b8bc-d77a-4003-9ac9-e433924abbcc-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ba4516b-98ba-418c-b2f8-b7ae93cc77a6 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-0c803e95-16c2-4d50-afce-e0b59494ef47-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-543c40f7-c7af-4807-8035-5b4c5c7598f3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-543c40f7-c7af-4807-8035-5b4c5c7598f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" acquired by "delete_volume" :: waited 0.043s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b81c70e-1dbf-4964-b34b-d6f39bc133d4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:37 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Flow 'volume_create_manager' (85aba4f7-255b-44be-962d-47e7eb7691e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9ec2a4-13db-49a6-a362-bac0503be959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9ec2a4-13db-49a6-a362-bac0503be959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698333209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f456df5-6b6b-4ba1-8d54-3957b507e303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbe2a819e3b4850aaf178edd408ba1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:37Z,use_quota=True,user_id='bb1c869cbf2247898dcf472cfe3744b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67deda82-1e49-44e5-b4ba-40c59f3d068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67deda82-1e49-44e5-b4ba-40c59f3d068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb831397-f102-4e13-a305-f89197ca3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb831397-f102-4e13-a305-f89197ca3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f456df5-6b6b-4ba1-8d54-3957b507e303', 'volume_name': 'volume-9f456df5-6b6b-4ba1-8d54-3957b507e303', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f332f3-d603-4182-aa5d-3b6e732cbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f332f3-d603-4182-aa5d-3b6e732cbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec586e9-8284-4d97-840c-81a0f7d22919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Volume 9f456df5-6b6b-4ba1-8d54-3957b507e303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f456df5-6b6b-4ba1-8d54-3957b507e303', 'volume_size': 1} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698333209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f456df5-6b6b-4ba1-8d54-3957b507e303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbe2a819e3b4850aaf178edd408ba1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:37Z,use_quota=True,user_id='bb1c869cbf2247898dcf472cfe3744b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Creating volume 9f456df5-6b6b-4ba1-8d54-3957b507e303 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:37 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 1073741824 Sep 01 02:12:37 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.752s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3 Sep 01 02:12:37 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-543c40f7-c7af-4807-8035-5b4c5c7598f3" returned: 0 in 0.663s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-543c40f7-c7af-4807-8035-5b4c5c7598f3" released by "delete_volume" :: held 1.543s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:38 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 1073741824" returned: 0 in 0.877s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Created reservations ['2ac762c3-668a-4112-9d3a-10c0c0c7fc9b', '188ad391-2bdd-4f64-9efc-9f58a55baef2', '35372ee9-88fd-4bb6-ad0b-6e0ae0b84599', '63ccc7b1-376b-4785-baf1-7b33ea2a8404'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 Sep 01 02:12:38 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:38 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303" returned: 0 in 0.307s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec586e9-8284-4d97-840c-81a0f7d22919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f456df5-6b6b-4ba1-8d54-3957b507e303', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa07e67-af67-4e91-b1f0-f66e5db66b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Volume volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 (9f456df5-6b6b-4ba1-8d54-3957b507e303): created successfully Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa07e67-af67-4e91-b1f0-f66e5db66b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Flow 'volume_create_manager' (85aba4f7-255b-44be-962d-47e7eb7691e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fa593a55-367f-4db2-9f8d-ecfa880b4586 tempest-ProjectReaderTests-227148902 None] Created volume successfully. Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-24cabe0b-cca7-4211-b0e2-0a8d084a6aba-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:38 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.369s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Deleted volume successfully. Sep 01 02:12:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-24cabe0b-cca7-4211-b0e2-0a8d084a6aba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-818cd6e3-92ca-4406-84ea-8c740c711821 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-543c40f7-c7af-4807-8035-5b4c5c7598f3-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d641684-4c6c-4f08-bec1-cff0d26708f0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba Sep 01 02:12:39 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Acquiring lock "cinder-9f456df5-6b6b-4ba1-8d54-3957b507e303-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "cinder-9f456df5-6b6b-4ba1-8d54-3957b507e303-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Acquiring lock "cinder-quobyte-9f456df5-6b6b-4ba1-8d54-3957b507e303" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:39 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" returned: 0 in 0.473s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "cinder-quobyte-9f456df5-6b6b-4ba1-8d54-3957b507e303" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba Sep 01 02:12:39 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9ce3b-1d9a-4538-b699-8490d5fff57b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 Sep 01 02:12:39 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-quobyte-24cabe0b-cca7-4211-b0e2-0a8d084a6aba" released by "delete_volume" :: held 0.885s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Created reservations ['e0ae04dd-2b4f-41c4-9a32-7bef50379344', '854b9894-996d-4ac0-a9e6-c96837744e06', '86327b17-8937-476a-abc0-eef8869b4655', '31b89522-bd13-47bc-b732-095cdc9e9d9b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303" returned: 0 in 0.493s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:40 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303 Sep 01 02:12:40 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Deleted volume successfully. Sep 01 02:12:40 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9f456df5-6b6b-4ba1-8d54-3957b507e303" returned: 0 in 0.285s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "cinder-quobyte-9f456df5-6b6b-4ba1-8d54-3957b507e303" released by "delete_volume" :: held 0.852s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57d5c865-72d7-438c-b4e0-d86a2e2c87b3 tempest-SnapshotDependencyTests-1369186889 None] Lock "cinder-24cabe0b-cca7-4211-b0e2-0a8d084a6aba-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Created reservations ['03fcd9b7-88fc-49cb-b37a-6c0e23bb2b9b', '933d086a-9807-43de-b50e-d84892e53892', '71b0baf9-d88c-4770-a928-7a28498dc69b', 'c9197aaa-9fbe-4152-a2c9-1fda86b5827d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:40 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.315s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:40 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:12:40 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Deleted volume successfully. Sep 01 02:12:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-563714a4-4ea8-48da-bd01-413d6f6ccc99 tempest-ProjectReaderTests-227148902 None] Lock "cinder-9f456df5-6b6b-4ba1-8d54-3957b507e303-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:41 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:12:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:12:50 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=56,cinder:UPDATE=72,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:50 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=66,cinder:INSERT=21,cinder:UPDATE=65,cinder:DELETE=7 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ff24c949-c48a-48f8-b8ba-1f2df991d988 req-15b7d6a7-ad88-49fe-9975-0e1ae2d81f29 tempest-TestMinimumBasicScenario-1327668380 None] Terminate volume connection completed successfully. Sep 01 02:13:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ff24c949-c48a-48f8-b8ba-1f2df991d988 req-15b7d6a7-ad88-49fe-9975-0e1ae2d81f29 tempest-TestMinimumBasicScenario-1327668380 None] Deleting attachment f4143265-d7d1-4411-971f-bc465b811b1f. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "cinder-64274e3d-76d3-4691-aeb0-bc090a002c93-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "cinder-64274e3d-76d3-4691-aeb0-bc090a002c93-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "cinder-quobyte-64274e3d-76d3-4691-aeb0-bc090a002c93" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "cinder-quobyte-64274e3d-76d3-4691-aeb0-bc090a002c93" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b168161-3023-4832-bcdc-528187c92ea2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:12 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 Sep 01 02:13:12 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:12 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93 Sep 01 02:13:12 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-64274e3d-76d3-4691-aeb0-bc090a002c93" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "cinder-quobyte-64274e3d-76d3-4691-aeb0-bc090a002c93" released by "delete_volume" :: held 0.693s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Created reservations ['b2af4e22-888d-4b9f-9416-a6ac2ae9de8c', '895a98a8-4cbc-4776-ac34-8ca48d76e22b', '58941cf9-7756-487e-93ad-1f83db77161a', '2899dff2-4509-4749-91bc-da2ca11f89ad'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:12 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:12 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Deleted volume successfully. Sep 01 02:13:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c496d338-01c9-42cf-8fe6-4ba84f02f7d8 tempest-TestMinimumBasicScenario-1327668380 None] Lock "cinder-64274e3d-76d3-4691-aeb0-bc090a002c93-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (bacc49c1-d11b-44d4-95da-6790674141c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3ebe32-c5d6-4da5-b865-9b17c154b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3ebe32-c5d6-4da5-b865-9b17c154b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1586418710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730dc1c6-2ee0-4355-ba4f-ab4a06459b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:14Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10c4f8-29b5-472a-b40b-0b27c1d9af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10c4f8-29b5-472a-b40b-0b27c1d9af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ead10f3-8e64-498a-b2b8-f822f13cfbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ead10f3-8e64-498a-b2b8-f822f13cfbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730dc1c6-2ee0-4355-ba4f-ab4a06459b6c', 'volume_name': 'volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5163620-d60e-4b39-a44b-1d0a4bd03e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5163620-d60e-4b39-a44b-1d0a4bd03e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342e1171-5aa2-4ca6-87d3-c1c24752893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Volume 730dc1c6-2ee0-4355-ba4f-ab4a06459b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c', 'volume_size': 1} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1586418710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730dc1c6-2ee0-4355-ba4f-ab4a06459b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:14Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Creating volume 730dc1c6-2ee0-4355-ba4f-ab4a06459b6c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:14 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c 1073741824 Sep 01 02:13:14 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c 1073741824" returned: 0 in 0.486s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c Sep 01 02:13:15 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342e1171-5aa2-4ca6-87d3-c1c24752893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef328c-e11c-4135-87b2-4c6a89648085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Volume volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c (730dc1c6-2ee0-4355-ba4f-ab4a06459b6c): created successfully Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef328c-e11c-4135-87b2-4c6a89648085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (bacc49c1-d11b-44d4-95da-6790674141c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d2d1e438-8fc7-4b7d-9d69-728626bd2165 tempest-AttachVolumeTestJSON-1522805662 None] Created volume successfully. Sep 01 02:13:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-10144b8f-bd92-4bf3-b0dc-7841249e631b req-7434fe99-26ea-4ae9-b084-91a789ffc1e5 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-10144b8f-bd92-4bf3-b0dc-7841249e631b req-7434fe99-26ea-4ae9-b084-91a789ffc1e5 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-10144b8f-bd92-4bf3-b0dc-7841249e631b req-7434fe99-26ea-4ae9-b084-91a789ffc1e5 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-10144b8f-bd92-4bf3-b0dc-7841249e631b req-7434fe99-26ea-4ae9-b084-91a789ffc1e5 tempest-AttachVolumeTestJSON-1522805662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8b18df2-9232-465a-b7a7-7d51d36f80e8', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-10144b8f-bd92-4bf3-b0dc-7841249e631b req-7434fe99-26ea-4ae9-b084-91a789ffc1e5 tempest-AttachVolumeTestJSON-1522805662 None] attachment_update completed successfully. Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (8e636349-21b1-43ac-85bc-7760fc370887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101b1768-f5dc-4a2a-b7c7-c6909d6673ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101b1768-f5dc-4a2a-b7c7-c6909d6673ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-755039159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc160ae5-939a-493f-b6f3-c25e1daa1850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:20Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b039e5-4751-436c-a8cd-3881cce87294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b039e5-4751-436c-a8cd-3881cce87294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895f46d-6b2a-4606-a229-39bfcd9bda3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895f46d-6b2a-4606-a229-39bfcd9bda3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc160ae5-939a-493f-b6f3-c25e1daa1850', 'volume_name': 'volume-dc160ae5-939a-493f-b6f3-c25e1daa1850', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6fd728-9d5e-4c59-86e4-0a923acbe4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6fd728-9d5e-4c59-86e4-0a923acbe4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb2b5db-0d41-478b-b416-8c427cccb90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Volume dc160ae5-939a-493f-b6f3-c25e1daa1850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc160ae5-939a-493f-b6f3-c25e1daa1850', 'volume_size': 1} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-755039159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc160ae5-939a-493f-b6f3-c25e1daa1850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d72d12918483392148bb37aa66d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:20Z,use_quota=True,user_id='98e8e522e16644ebb7280cef546cfe5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Creating volume dc160ae5-939a-493f-b6f3-c25e1daa1850 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:19 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 1073741824 Sep 01 02:13:19 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:20 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 1073741824" returned: 0 in 0.498s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:20 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 Sep 01 02:13:20 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:20 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb2b5db-0d41-478b-b416-8c427cccb90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc160ae5-939a-493f-b6f3-c25e1daa1850', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc9cb69-68b3-47ec-aa9c-8cd40d7df5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Volume volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 (dc160ae5-939a-493f-b6f3-c25e1daa1850): created successfully Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc9cb69-68b3-47ec-aa9c-8cd40d7df5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Flow 'volume_create_manager' (8e636349-21b1-43ac-85bc-7760fc370887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-49a230c8-b438-40eb-be0f-fba6c280f8fc tempest-AttachVolumeTestJSON-1522805662 None] Created volume successfully. Sep 01 02:13:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-e8111c69-2550-4673-9baa-88a9326d2248 req-244c2288-efe5-4310-9b7a-88317967cff5 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-e8111c69-2550-4673-9baa-88a9326d2248 req-244c2288-efe5-4310-9b7a-88317967cff5 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-e8111c69-2550-4673-9baa-88a9326d2248 req-244c2288-efe5-4310-9b7a-88317967cff5 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:22 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-e8111c69-2550-4673-9baa-88a9326d2248 req-244c2288-efe5-4310-9b7a-88317967cff5 tempest-AttachVolumeTestJSON-1522805662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-dc160ae5-939a-493f-b6f3-c25e1daa1850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae8845e1-78b4-4eb7-9cb5-3d090266c413', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-e8111c69-2550-4673-9baa-88a9326d2248 req-244c2288-efe5-4310-9b7a-88317967cff5 tempest-AttachVolumeTestJSON-1522805662 None] attachment_update completed successfully. Sep 01 02:13:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-c242bdd3-ccde-48c7-8ed2-b3a9b4deb391 req-84df243e-3934-4181-9b40-59e327f85e19 tempest-AttachVolumeTestJSON-1522805662 None] Terminate volume connection completed successfully. Sep 01 02:13:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-c242bdd3-ccde-48c7-8ed2-b3a9b4deb391 req-84df243e-3934-4181-9b40-59e327f85e19 tempest-AttachVolumeTestJSON-1522805662 None] Deleting attachment f8b18df2-9232-465a-b7a7-7d51d36f80e8. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-d1e92916-9fbf-4eab-9c04-871d3bb3027b req-e86ab7ee-4269-4a13-a0bd-a8f776d1d35e tempest-AttachVolumeTestJSON-1522805662 None] Terminate volume connection completed successfully. Sep 01 02:13:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-d1e92916-9fbf-4eab-9c04-871d3bb3027b req-e86ab7ee-4269-4a13-a0bd-a8f776d1d35e tempest-AttachVolumeTestJSON-1522805662 None] Deleting attachment ae8845e1-78b4-4eb7-9cb5-3d090266c413. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (48132d50-f61c-4d27-9b6b-a38fcfd23694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7556ded-4e12-467e-bb48-39a5510a2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7556ded-4e12-467e-bb48-39a5510a2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313406063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a055153c-8346-4003-9e05-629cfb37cccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4f0c12-5586-45e3-a0b6-36ed48a1b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4f0c12-5586-45e3-a0b6-36ed48a1b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6be32f3-e350-4d21-98ae-8176d90de49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6be32f3-e350-4d21-98ae-8176d90de49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a055153c-8346-4003-9e05-629cfb37cccc', 'volume_name': 'volume-a055153c-8346-4003-9e05-629cfb37cccc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7249c84-30a7-4428-a853-f1fea059fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7249c84-30a7-4428-a853-f1fea059fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d880da-3cde-4fe9-93f1-b2f2a859797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume a055153c-8346-4003-9e05-629cfb37cccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a055153c-8346-4003-9e05-629cfb37cccc', 'volume_size': 1} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313406063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a055153c-8346-4003-9e05-629cfb37cccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:30 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc 1073741824 Sep 01 02:13:30 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc 1073741824" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc Sep 01 02:13:30 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d880da-3cde-4fe9-93f1-b2f2a859797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a055153c-8346-4003-9e05-629cfb37cccc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56897441-d37e-4c64-b698-edb0773a0a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-a055153c-8346-4003-9e05-629cfb37cccc (a055153c-8346-4003-9e05-629cfb37cccc): created successfully Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56897441-d37e-4c64-b698-edb0773a0a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (48132d50-f61c-4d27-9b6b-a38fcfd23694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6f179167-06d0-41d1-9975-250c80f62d7d tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-dc160ae5-939a-493f-b6f3-c25e1daa1850-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-dc160ae5-939a-493f-b6f3-c25e1daa1850-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-quobyte-dc160ae5-939a-493f-b6f3-c25e1daa1850" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-dc160ae5-939a-493f-b6f3-c25e1daa1850" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccde59a-900d-4e1b-9ee2-b73a761d457c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 Sep 01 02:13:32 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating offline snapshot 804e5704-9bda-46f6-9184-d34e97a2f191 of volume a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c874869d-c330-4d5a-b54c-6e11c5eeb2fd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc Sep 01 02:13:32 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850 Sep 01 02:13:32 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-dc160ae5-939a-493f-b6f3-c25e1daa1850" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 1G Sep 01 02:13:32 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-dc160ae5-939a-493f-b6f3-c25e1daa1850" released by "delete_volume" :: held 0.672s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Created reservations ['2ea85b5d-1a60-4ac7-9804-ca4b44d5dc7d', '7e334d68-85d1-4f25-8abc-ec9afa0899c8', '27bc1478-e931-42c0-9e87-2d9e1610c6ae', '5173d647-3c85-4fd0-99e7-b4d9a5d322e9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:32 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 1G" returned: 0 in 0.422s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a055153c-8346-4003-9e05-629cfb37cccc -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Deleted volume successfully. Sep 01 02:13:33 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a055153c-8346-4003-9e05-629cfb37cccc -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 Sep 01 02:13:33 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b6047403-9c21-4c83-b492-2bacd5e513a8 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-dc160ae5-939a-493f-b6f3-c25e1daa1850-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-quobyte-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685198e-20c5-4a00-bbc5-49d856a6da4f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c Sep 01 02:13:33 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a055153c-8346-4003-9e05-629cfb37cccc -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 is being set with open permissions: ugo+rw Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 Sep 01 02:13:33 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c Sep 01 02:13:33 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info Sep 01 02:13:33 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c" released by "delete_volume" :: held 0.662s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Created reservations ['6f718f70-93e9-42af-965a-6cef2bd1c191', 'ec1e8403-ac3d-4ac5-8031-6c17c6a0dddf', '509a186d-8e20-4c28-a399-f7322d49b92a', '7446b406-fa2f-42ad-8bcc-7761fb36bad6'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:33 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info is being set with open permissions: ugo+rw Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info Sep 01 02:13:33 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:33 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.info" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:34 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Deleted volume successfully. Sep 01 02:13:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-cb0b44a9-c51f-443a-b000-23d777172321 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Create snapshot completed successfully Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9ac28c8a-b6d0-4380-b3fb-e2db8671e03e tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-730dc1c6-2ee0-4355-ba4f-ab4a06459b6c-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-04a1991f-cdef-4170-ad7e-2fa3ffb917ff-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-04a1991f-cdef-4170-ad7e-2fa3ffb917ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "cinder-quobyte-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6e4cb-8dd8-486e-9d2d-08b40b19f746]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff Sep 01 02:13:34 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:34 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (2d445c69-a6e7-470b-aa75-94a5b14dc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03242c68-4129-4cff-8fad-cd5de637702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" returned: 0 in 0.448s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03242c68-4129-4cff-8fad-cd5de637702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116651568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:35Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:34 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff Sep 01 02:13:34 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8b5f09-bf22-4608-a298-47bf1ccec63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8b5f09-bf22-4608-a298-47bf1ccec63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6135c368-b617-45aa-b52e-16afeb8146a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6135c368-b617-45aa-b52e-16afeb8146a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6', 'volume_name': 'volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d6a4db-1ded-414e-bad8-c54fc827603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d6a4db-1ded-414e-bad8-c54fc827603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ac8287-2031-44cc-a5c7-a1cd02a5fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume 79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6', 'volume_size': 1} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116651568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:35Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume 79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:34 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 1073741824 Sep 01 02:13:35 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-quobyte-04a1991f-cdef-4170-ad7e-2fa3ffb917ff" released by "delete_volume" :: held 0.777s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (7fa5d8b1-1a9b-49db-839b-c9f9fc57dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff8462-2f8a-44fa-a196-4a3d9f8e880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Created reservations ['14846ab0-6b37-4ce2-a2d6-320ee8c96653', '2e11e348-45ac-4279-9647-2840c6eecbe9', '9642cfc8-6767-4f6c-be47-8678fe3ee31c', 'bc2fa4bf-fec5-4818-8b9f-53d93cb7ac2f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff8462-2f8a-44fa-a196-4a3d9f8e880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726833724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac32aa1-63af-4feb-94e7-542f9c22e27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:35Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b127b95d-4965-4634-85ba-ec9ddcc760b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b127b95d-4965-4634-85ba-ec9ddcc760b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d61778-0e6d-4afb-bd70-c31ba573b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d61778-0e6d-4afb-bd70-c31ba573b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac32aa1-63af-4feb-94e7-542f9c22e27b', 'volume_name': 'volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aac0c6-8661-4244-8ab4-b20cba8f6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aac0c6-8661-4244-8ab4-b20cba8f6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0ccf4e-954e-4a41-a183-2cc1210000c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume 4ac32aa1-63af-4feb-94e7-542f9c22e27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b', 'volume_size': 1} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 1073741824" returned: 0 in 0.534s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:35 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 Sep 01 02:13:35 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (60aa7494-4feb-4a1a-80e2-86c83f241552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96562d78-4efc-496d-8ba4-7033b6836dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96562d78-4efc-496d-8ba4-7033b6836dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067309773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d77e101-eb91-4404-b717-2f69862f5a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f3c23-5e21-4fb6-a2ab-9e62bb0e605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f3c23-5e21-4fb6-a2ab-9e62bb0e605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f766d94-49cd-489a-8a45-05e772e8d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f766d94-49cd-489a-8a45-05e772e8d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d77e101-eb91-4404-b717-2f69862f5a66', 'volume_name': 'volume-9d77e101-eb91-4404-b717-2f69862f5a66', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c0e36a-e468-4f21-96c0-bfd434c9a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c0e36a-e468-4f21-96c0-bfd434c9a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df308fe1-8a7d-41f2-85b1-d0dd873c94c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume 9d77e101-eb91-4404-b717-2f69862f5a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d77e101-eb91-4404-b717-2f69862f5a66', 'volume_size': 1} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Deleted volume successfully. Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57653d7f-5ce3-4728-ac5c-03cfe97b8195 tempest-AttachVolumeTestJSON-1522805662 None] Lock "cinder-04a1991f-cdef-4170-ad7e-2fa3ffb917ff-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:35 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" returned: 0 in 0.402s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726833724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac32aa1-63af-4feb-94e7-542f9c22e27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:35Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume 4ac32aa1-63af-4feb-94e7-542f9c22e27b {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:35 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:36 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b 1073741824 Sep 01 02:13:36 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ac8287-2031-44cc-a5c7-a1cd02a5fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb466c8f-8dab-448f-9767-3459052771c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 (79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6): created successfully Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb466c8f-8dab-448f-9767-3459052771c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (2d445c69-a6e7-470b-aa75-94a5b14dc2db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-99327c7e-3760-418e-9f2d-47cfe5b1692b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (cae37c86-bab6-4915-bddf-95ebe02de8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561453e3-4940-49f0-8dc1-577433775b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561453e3-4940-49f0-8dc1-577433775b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503068817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218bdca7-d046-4916-8dc6-40ae6c796943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb317368-42ec-4af5-8ba1-6d4c97c0e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb317368-42ec-4af5-8ba1-6d4c97c0e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f527519a-5a92-4662-9841-45bb7eca565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f527519a-5a92-4662-9841-45bb7eca565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218bdca7-d046-4916-8dc6-40ae6c796943', 'volume_name': 'volume-218bdca7-d046-4916-8dc6-40ae6c796943', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be210b0-e403-4dad-a36a-02e8740a5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be210b0-e403-4dad-a36a-02e8740a5854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c784c04-c8c4-4456-a7f1-28031b746355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume 218bdca7-d046-4916-8dc6-40ae6c796943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218bdca7-d046-4916-8dc6-40ae6c796943', 'volume_size': 1} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:36 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b 1073741824" returned: 0 in 0.641s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (071fbe3a-c5fb-430a-9899-461ca4375821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba959db-18e0-46e5-bd05-db2546090a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba959db-18e0-46e5-bd05-db2546090a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621021815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e850c3e-4663-49aa-b14f-872fe550ae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:37Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724773c6-a19f-4a2e-b97c-ed6000c0917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724773c6-a19f-4a2e-b97c-ed6000c0917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71501352-9acc-4c9e-9f73-b6d3562050be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71501352-9acc-4c9e-9f73-b6d3562050be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e850c3e-4663-49aa-b14f-872fe550ae2d', 'volume_name': 'volume-0e850c3e-4663-49aa-b14f-872fe550ae2d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98480ea1-a6cf-4260-9576-83e10987be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98480ea1-a6cf-4260-9576-83e10987be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03670d9-02e6-4aa0-a5ab-88ab0854b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume 0e850c3e-4663-49aa-b14f-872fe550ae2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e850c3e-4663-49aa-b14f-872fe550ae2d', 'volume_size': 1} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:36 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b Sep 01 02:13:36 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067309773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d77e101-eb91-4404-b717-2f69862f5a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume 9d77e101-eb91-4404-b717-2f69862f5a66 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0ccf4e-954e-4a41-a183-2cc1210000c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 1073741824 Sep 01 02:13:37 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a06891-eca4-4ec0-adb2-4a39cd083f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b (4ac32aa1-63af-4feb-94e7-542f9c22e27b): created successfully Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a06891-eca4-4ec0-adb2-4a39cd083f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (7fa5d8b1-1a9b-49db-839b-c9f9fc57dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-58872b3e-2549-48ea-8c09-60459c36734c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:37 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 1073741824" returned: 0 in 0.414s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 Sep 01 02:13:37 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503068817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218bdca7-d046-4916-8dc6-40ae6c796943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume 218bdca7-d046-4916-8dc6-40ae6c796943 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df308fe1-8a7d-41f2-85b1-d0dd873c94c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d77e101-eb91-4404-b717-2f69862f5a66', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096cc864-a90d-4012-9669-c814eb82bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 1073741824 Sep 01 02:13:37 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-9d77e101-eb91-4404-b717-2f69862f5a66 (9d77e101-eb91-4404-b717-2f69862f5a66): created successfully Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096cc864-a90d-4012-9669-c814eb82bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (60aa7494-4feb-4a1a-80e2-86c83f241552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9f573ef0-5524-4910-9cb8-04c17cf6e04a tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:38 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 1073741824" returned: 0 in 0.452s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:38 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 Sep 01 02:13:38 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:38 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621021815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e850c3e-4663-49aa-b14f-872fe550ae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69fbf8e6191c45fb84f304d7eae5f068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:37Z,use_quota=True,user_id='f89f1752977149ab911637918b2df434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Creating volume 0e850c3e-4663-49aa-b14f-872fe550ae2d {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:38 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c784c04-c8c4-4456-a7f1-28031b746355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218bdca7-d046-4916-8dc6-40ae6c796943', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:38 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d 1073741824 Sep 01 02:13:38 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c640970b-dd47-4140-b362-5684980e01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:38 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-218bdca7-d046-4916-8dc6-40ae6c796943 (218bdca7-d046-4916-8dc6-40ae6c796943): created successfully Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c640970b-dd47-4140-b362-5684980e01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (cae37c86-bab6-4915-bddf-95ebe02de8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-cb3f91e6-6f31-4fba-a897-ac7d0722b675 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:39 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d 1073741824" returned: 0 in 0.462s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:39 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d Sep 01 02:13:39 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03670d9-02e6-4aa0-a5ab-88ab0854b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e850c3e-4663-49aa-b14f-872fe550ae2d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf31309-58f3-447f-8441-5d23b556ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:39 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Volume volume-0e850c3e-4663-49aa-b14f-872fe550ae2d (0e850c3e-4663-49aa-b14f-872fe550ae2d): created successfully Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf31309-58f3-447f-8441-5d23b556ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Flow 'volume_create_manager' (071fbe3a-c5fb-430a-9899-461ca4375821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-76fb1834-88bc-450a-8e34-ac1fc9749ca6 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created volume successfully. Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-0e850c3e-4663-49aa-b14f-872fe550ae2d-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-0e850c3e-4663-49aa-b14f-872fe550ae2d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-0e850c3e-4663-49aa-b14f-872fe550ae2d" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-0e850c3e-4663-49aa-b14f-872fe550ae2d" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effe8a4-058f-42d4-8e2c-a145a774cb2c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:40 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d Sep 01 02:13:40 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:40 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:40 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d Sep 01 02:13:40 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:40 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0e850c3e-4663-49aa-b14f-872fe550ae2d" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-0e850c3e-4663-49aa-b14f-872fe550ae2d" released by "delete_volume" :: held 0.679s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['2543e512-5fb3-480a-89fc-b60179926bb2', '2763a834-d6bb-439c-8537-905ac86dbe34', 'efbebfc2-7648-4654-9283-825eb93f0c89', '9f24939b-2496-4e10-ba80-e17a3834019c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:40 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:40 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:40 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:40 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-218bdca7-d046-4916-8dc6-40ae6c796943-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-218bdca7-d046-4916-8dc6-40ae6c796943-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:41 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.315s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-218bdca7-d046-4916-8dc6-40ae6c796943" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-950f3f1f-0744-40d9-addc-6ff0edc6653b tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-0e850c3e-4663-49aa-b14f-872fe550ae2d-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-218bdca7-d046-4916-8dc6-40ae6c796943" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[35410127-0163-4cd4-9a3b-89b2770c59a2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 Sep 01 02:13:41 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943 Sep 01 02:13:41 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-218bdca7-d046-4916-8dc6-40ae6c796943" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-218bdca7-d046-4916-8dc6-40ae6c796943" released by "delete_volume" :: held 0.686s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['e60024e1-b9a8-416e-a481-0f6787db20ac', '78ad2257-910b-4a54-8629-517e5f5c513b', 'f47ec2ea-918e-4c80-aba3-71d725d5185a', '630c8d10-eb07-4e43-8025-81aff9292e41'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:42 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-9d77e101-eb91-4404-b717-2f69862f5a66-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:42 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-9d77e101-eb91-4404-b717-2f69862f5a66-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2ab0c6bd-f82f-4c39-86b1-436a5c9bb7c1 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-218bdca7-d046-4916-8dc6-40ae6c796943-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-9d77e101-eb91-4404-b717-2f69862f5a66" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-9d77e101-eb91-4404-b717-2f69862f5a66" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55c88c-49bb-40d0-af99-a7430d4d3c2f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 Sep 01 02:13:42 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:42 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66 Sep 01 02:13:42 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9d77e101-eb91-4404-b717-2f69862f5a66" returned: 0 in 0.291s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-9d77e101-eb91-4404-b717-2f69862f5a66" released by "delete_volume" :: held 0.695s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['d00383c8-a617-4f89-aac7-16e69f5fe17e', '344dc50a-7cf0-41d2-8ca6-7658d6c9e4fa', '99fc6890-39d0-43e8-9147-64e414408f44', 'f4e3cce8-90c8-49d5-b9ec-b4de84523c74'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:43 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-4ac32aa1-63af-4feb-94e7-542f9c22e27b-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-15037251-c748-4540-ad07-d67d60672a4c tempest-BackendsCapabilitiesAdminTestsJSON-266473051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.039436340332, 'free_capacity_gb': 1774.039436340332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86925) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-4ac32aa1-63af-4feb-94e7-542f9c22e27b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d976d9cc-1fb0-46b7-adb6-8b2913164077 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-9d77e101-eb91-4404-b717-2f69862f5a66-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-4ac32aa1-63af-4feb-94e7-542f9c22e27b" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e972b989-63d2-4fd1-aea2-4a809d65d6ba tempest-BackendsCapabilitiesAdminTestsJSON-266473051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.039436340332, 'free_capacity_gb': 1774.039436340332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86925) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-4ac32aa1-63af-4feb-94e7-542f9c22e27b" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9dfc17-282e-4e66-80a3-0145dbfb1297]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b Sep 01 02:13:43 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b Sep 01 02:13:44 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4ac32aa1-63af-4feb-94e7-542f9c22e27b" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-4ac32aa1-63af-4feb-94e7-542f9c22e27b" released by "delete_volume" :: held 0.714s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['bce76903-fd19-4027-806c-91544261218f', '0a5fcb99-94ae-45cf-9cef-8d8309d28ae1', '338113e7-ef87-4148-8f0b-5d0e87f70f98', '5d175b2b-b9ca-4ebc-8207-d17005ff4ba9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:44 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.318s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b8c77100-19dc-469f-a93c-60bef6003562 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-4ac32aa1-63af-4feb-94e7-542f9c22e27b-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b7600-dd9d-4e1e-b59b-2c353e3f4947]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 Sep 01 02:13:45 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6 Sep 01 02:13:45 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6" released by "delete_volume" :: held 0.724s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['5c852d56-6f9b-443d-b699-9f8678e152b4', '4dc9c57e-a9da-4f09-bbfe-f255a56eb7c4', '88787788-2ef9-4ee3-bfbb-e9bb7ad56799', 'bd049880-6d75-41ff-afdb-777aaa4b73b1'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:45 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-804e5704-9bda-46f6-9184-d34e97a2f191-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-804e5704-9bda-46f6-9184-d34e97a2f191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-804e5704-9bda-46f6-9184-d34e97a2f191" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-804e5704-9bda-46f6-9184-d34e97a2f191" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:46 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleting offline snapshot 804e5704-9bda-46f6-9184-d34e97a2f191 of volume a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] snapshot_file for this snap is: volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de74ea-7fb6-4562-94d7-3e73ff99f795]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f976067c-0a5f-4d82-a8ec-474976595d7c tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-79dc5b6c-d364-4a24-b75d-f3dbeadd1cd6-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:46 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 Sep 01 02:13:46 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a055153c-8346-4003-9e05-629cfb37cccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9664154-c4e7-4683-a880-86d695f59a94]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:46 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc Sep 01 02:13:46 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc" returned: 0 in 0.377s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:46 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 Sep 01 02:13:46 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191 Sep 01 02:13:47 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc.804e5704-9bda-46f6-9184-d34e97a2f191" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-804e5704-9bda-46f6-9184-d34e97a2f191" released by "_delete_snapshot" :: held 1.509s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" released by "delete_snapshot" :: held 1.537s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['fd4c400c-76a4-44d4-bf35-04fb49546a28', '60a5691b-7f2f-4031-b18d-58828b7ca520', '17109d4d-a5f5-4912-8f40-92227ce65084', '3000f68d-9cdc-452d-ac61-d2ee24b83bd8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Delete snapshot completed successfully. Sep 01 02:13:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7609ad65-4b5f-459d-8575-a8e0bddbbdee tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-804e5704-9bda-46f6-9184-d34e97a2f191-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-a055153c-8346-4003-9e05-629cfb37cccc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-a055153c-8346-4003-9e05-629cfb37cccc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[05326702-7ca8-4f2b-8835-2a514529d071]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:48 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc Sep 01 02:13:48 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:48 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:48 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc Sep 01 02:13:48 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4c4fa676-3878-4bec-bf3e-0c0df2a6f1a8 tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-692548197: creating Sep 01 02:13:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4c4fa676-3878-4bec-bf3e-0c0df2a6f1a8 tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-692548197: created successfully Sep 01 02:13:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4c4fa676-3878-4bec-bf3e-0c0df2a6f1a8 tempest-GroupSnapshotsTest-466359133 None] Create group completed successfully. Sep 01 02:13:48 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a055153c-8346-4003-9e05-629cfb37cccc" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-quobyte-a055153c-8346-4003-9e05-629cfb37cccc" released by "delete_volume" :: held 0.705s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Created reservations ['882b2a56-4d66-4188-a73b-bb39de5811e5', '421b68fa-314b-483b-930c-dff24392be17', 'cae6f3be-5984-49ff-be65-a2a9a961b86c', '01e62955-b942-4b0b-9581-8bddba81d115'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:49 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:49 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:49 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Deleted volume successfully. Sep 01 02:13:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc4bff21-a772-47f5-a473-9f113a5c2818 tempest-CreateVolumesFromSnapshotTest-1306605220 None] Lock "cinder-a055153c-8346-4003-9e05-629cfb37cccc-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (39bff1e5-7e05-4118-afcf-29932792d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4071970-2217-49e8-a47e-6faf4bc9ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4071970-2217-49e8-a47e-6faf4bc9ec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-76113915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=284ef4d2-1bd4-46c6-917d-41db692583bc,host='devstack@QuobyteHD#QuobyteHD',id=f571df97-3e20-4ead-a30d-eb60701044ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:50Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8731477a-1301-4c20-8b71-71240b76a898),volume_type_id=8731477a-1301-4c20-8b71-71240b76a898)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0a7c51-97be-424f-9fb7-8a71fa0b00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0a7c51-97be-424f-9fb7-8a71fa0b00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d0f4a9-67ad-4528-864d-e7777dbfe968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d0f4a9-67ad-4528-864d-e7777dbfe968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f571df97-3e20-4ead-a30d-eb60701044ee', 'volume_name': 'volume-f571df97-3e20-4ead-a30d-eb60701044ee', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6667183-b880-48d9-a04b-e79a8ac77ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6667183-b880-48d9-a04b-e79a8ac77ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b867f3b-eb27-4c46-a6ee-bc249943c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Volume f571df97-3e20-4ead-a30d-eb60701044ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f571df97-3e20-4ead-a30d-eb60701044ee', 'volume_size': 1} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=284ef4d2-1bd4-46c6-917d-41db692583bc,created_at=2026-09-01T00:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-76113915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=284ef4d2-1bd4-46c6-917d-41db692583bc,host='devstack@QuobyteHD#QuobyteHD',id=f571df97-3e20-4ead-a30d-eb60701044ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:50Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8731477a-1301-4c20-8b71-71240b76a898),volume_type_id=8731477a-1301-4c20-8b71-71240b76a898)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Creating volume f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:50 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:50 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee 1073741824 Sep 01 02:13:50 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:51 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee 1073741824" returned: 0 in 0.500s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:51 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:13:51 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:51 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.286s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b867f3b-eb27-4c46-a6ee-bc249943c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f571df97-3e20-4ead-a30d-eb60701044ee', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90868844-f56a-4681-8ee4-fb609d31ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:51 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Volume volume-f571df97-3e20-4ead-a30d-eb60701044ee (f571df97-3e20-4ead-a30d-eb60701044ee): created successfully Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90868844-f56a-4681-8ee4-fb609d31ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (39bff1e5-7e05-4118-afcf-29932792d002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-90a0bdd2-33c7-4f73-b0ef-7f15e23a3029 tempest-GroupSnapshotsTest-466359133 None] Created volume successfully. Sep 01 02:13:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] GroupSnapshot 9e28ea89-a728-4212-a70c-6ad613572f34: creating. Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Group snapshot 9e28ea89-a728-4212-a70c-6ad613572f34: creating. {{(pid=86925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Creating offline snapshot 3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 of volume f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8200cb-204a-4f50-b6ef-ff5a880a2772]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:13:52 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.379s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 1G Sep 01 02:13:52 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 1G" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571df97-3e20-4ead-a30d-eb60701044ee -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571df97-3e20-4ead-a30d-eb60701044ee -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:13:52 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571df97-3e20-4ead-a30d-eb60701044ee -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.320s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:13:53 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (ad664ab5-1815-4dde-81c2-8c3c636ee6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479526a-cb7d-4505-bfb1-891661c12331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479526a-cb7d-4505-bfb1-891661c12331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498280038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b46d8f-a095-456b-a55a-96d5b84d8b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:53Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eff2596-8f95-42af-8bd9-e0a23787858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eff2596-8f95-42af-8bd9-e0a23787858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc9d111-cc9e-41c6-9d51-db753637f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc9d111-cc9e-41c6-9d51-db753637f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b46d8f-a095-456b-a55a-96d5b84d8b1e', 'volume_name': 'volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c2afa2-2d74-4a17-95c1-606780cfbf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c2afa2-2d74-4a17-95c1-606780cfbf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e073b361-8e99-4223-9986-c88b36917ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Volume 18b46d8f-a095-456b-a55a-96d5b84d8b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e', 'volume_size': 1} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:53 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info Sep 01 02:13:53 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info Sep 01 02:13:53 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.info" returned: 0 in 0.226s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498280038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b46d8f-a095-456b-a55a-96d5b84d8b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:53Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Creating volume 18b46d8f-a095-456b-a55a-96d5b84d8b1e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:53 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:13:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e 1073741824 Sep 01 02:13:53 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-35b6c33d-4538-471c-9d60-e81204cac7a8 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 9e28ea89-a728-4212-a70c-6ad613572f34: created successfully Sep 01 02:13:54 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e 1073741824" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:54 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e Sep 01 02:13:54 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:54 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e073b361-8e99-4223-9986-c88b36917ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a654b7-5a46-46e4-bcd8-80b3826fcb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:54 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Volume volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e (18b46d8f-a095-456b-a55a-96d5b84d8b1e): created successfully Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a654b7-5a46-46e4-bcd8-80b3826fcb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (ad664ab5-1815-4dde-81c2-8c3c636ee6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-73d638cf-05fc-4b36-8609-27444407db74 tempest-ProjectReaderTests-1708844988 None] Created volume successfully. Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28-b99d179d-1301-4394-b559-5dc98e264577" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28-b99d179d-1301-4394-b559-5dc98e264577" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Creating volume b99d179d-1301-4394-b559-5dc98e264577 from snapshot 3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] snapshot: 3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28, volume: b99d179d-1301-4394-b559-5dc98e264577, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97dae2e-100f-4c5f-b14c-18542b24b9c2]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:55 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:13:55 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:55 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f571df97-3e20-4ead-a30d-eb60701044ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f777c24-d9e3-4f44-8e00-72dd58287bfe]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:55 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:13:55 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-18b46d8f-a095-456b-a55a-96d5b84d8b1e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "cinder-18b46d8f-a095-456b-a55a-96d5b84d8b1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-quobyte-18b46d8f-a095-456b-a55a-96d5b84d8b1e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-18b46d8f-a095-456b-a55a-96d5b84d8b1e" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cad146-cf0e-4e31-a918-36cbea7265ec]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:55 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.376s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:55 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 Sep 01 02:13:55 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:55 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e Sep 01 02:13:55 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:56 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e Sep 01 02:13:56 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:56 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-18b46d8f-a095-456b-a55a-96d5b84d8b1e" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-18b46d8f-a095-456b-a55a-96d5b84d8b1e" released by "delete_volume" :: held 0.822s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Created reservations ['c32dcda1-8f57-4cea-b8d0-a3bc1d547ce1', '04ca2309-eda4-42ca-a1ce-37cbcbc85f16', '3e8a2518-ac30-4998-b24d-5e563ed57cb4', '40bdab67-9f9d-4444-93c6-8331088e3ae2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:13:56 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.500s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Deleted volume successfully. Sep 01 02:13:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b5eeeeb1-47ad-4280-8088-2731b102a05c tempest-ProjectReaderTests-1708844988 None] Lock "cinder-18b46d8f-a095-456b-a55a-96d5b84d8b1e-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (dcbf4887-c1a2-4a39-b1c0-76ecf871bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44632506-21a8-4f79-acd0-e0ba5063a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44632506-21a8-4f79-acd0-e0ba5063a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782416384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca14249-affc-47be-8181-aa8085b3f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:59Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc554ae-e9cd-41cf-84a3-3efd766b9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc554ae-e9cd-41cf-84a3-3efd766b9234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017ed4d8-0dd3-4ebd-b1a9-ec1da9499da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017ed4d8-0dd3-4ebd-b1a9-ec1da9499da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca14249-affc-47be-8181-aa8085b3f1e0', 'volume_name': 'volume-8ca14249-affc-47be-8181-aa8085b3f1e0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d40da9f-d919-4d08-9e7a-ff483da8ac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d40da9f-d919-4d08-9e7a-ff483da8ac6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e598cf1-9bd0-4087-82d1-b01ae19e795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Volume 8ca14249-affc-47be-8181-aa8085b3f1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca14249-affc-47be-8181-aa8085b3f1e0', 'volume_size': 1} Sep 01 02:13:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:00 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577" returned: 0 in 4.452s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:14:00 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Converted 1024.00 MB image at 229.95 MB/s Sep 01 02:14:00 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 Sep 01 02:14:00 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" released by "_copy_volume_from_snapshot" :: held 5.522s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28-b99d179d-1301-4394-b559-5dc98e264577" released by "_create_volume_from_snapshot" :: held 5.588s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.609s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782416384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca14249-affc-47be-8181-aa8085b3f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:59Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Creating volume 8ca14249-affc-47be-8181-aa8085b3f1e0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:00 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 1073741824 Sep 01 02:14:00 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a1cdd6a8-3406-42ef-9773-aae98380df5b tempest-GroupSnapshotsTest-466359133 None] Create group from source-snapshot-9e28ea89-a728-4212-a70c-6ad613572f34 completed successfully. Sep 01 02:14:00 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 1073741824" returned: 0 in 0.434s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 Sep 01 02:14:00 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=111,cinder:UPDATE=133,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e598cf1-9bd0-4087-82d1-b01ae19e795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca14249-affc-47be-8181-aa8085b3f1e0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d605bc9-e308-4847-8de5-a17370332bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Volume volume-8ca14249-affc-47be-8181-aa8085b3f1e0 (8ca14249-affc-47be-8181-aa8085b3f1e0): created successfully Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d605bc9-e308-4847-8de5-a17370332bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (dcbf4887-c1a2-4a39-b1c0-76ecf871bf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:01 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-82454344-d492-4eaf-9414-51684f14bbf7 tempest-ProjectReaderTests-1708844988 None] Created volume successfully. Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06abb87-76a6-40a7-887a-a9ff6bfdd63b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 Sep 01 02:14:01 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577" returned: 0 in 0.360s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577 Sep 01 02:14:01 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b99d179d-1301-4394-b559-5dc98e264577" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b99d179d-1301-4394-b559-5dc98e264577" released by "delete_volume" :: held 0.633s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['4e5dd52f-a602-4e88-b6f2-f43a396b792a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:02 devstack cinder-volume[86925]: WARNING cinder.quota [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-786345724 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-786345724, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:02 devstack cinder-volume[86925]: WARNING cinder.quota [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-786345724 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-786345724, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['4c56be7b-35bd-42af-93a4-7e7bf919dbed', '20e33922-fca7-4d67-817e-dd3c1c135d40', '9badb2e1-dc9c-49bc-aa3a-ad131330375e', '9146e34d-70c7-4a38-be5a-caa8445436b6'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:02 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-8ca14249-affc-47be-8181-aa8085b3f1e0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "cinder-8ca14249-affc-47be-8181-aa8085b3f1e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-quobyte-8ca14249-affc-47be-8181-aa8085b3f1e0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-8ca14249-affc-47be-8181-aa8085b3f1e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bbc30d-0518-4274-8bd8-ed07904047d8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 Sep 01 02:14:02 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f051e270-a74a-4d1a-b41e-9cada9da44a1 tempest-GroupSnapshotsTest-466359133 None] Delete group completed successfully. Sep 01 02:14:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] group_snapshot 9e28ea89-a728-4212-a70c-6ad613572f34: deleting Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] group_snapshot 9e28ea89-a728-4212-a70c-6ad613572f34: deleting {{(pid=86925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Deleting offline snapshot 3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 of volume f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] snapshot_file for this snap is: volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda4b58-266a-434f-b326-866dbd966e1f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0" returned: 0 in 0.384s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0 Sep 01 02:14:02 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:14:02 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8ca14249-affc-47be-8181-aa8085b3f1e0" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-8ca14249-affc-47be-8181-aa8085b3f1e0" released by "delete_volume" :: held 0.664s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Created reservations ['83366cc7-11a7-4604-90c6-38eec9b39f8e', '5cc49ca9-149d-4c7d-81dd-cb98831fe862', '732f6dcf-6127-43f4-9ca6-c190cdbe6032', '799961ff-2f9e-4ada-9c74-15e9865614f0'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:03 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f571df97-3e20-4ead-a30d-eb60701044ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec65692-f4d5-4986-bd1e-e447a67a3bf4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:03 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:14:03 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:03 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Deleted volume successfully. Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c3c83f01-709e-4b81-8519-38203812554b tempest-ProjectReaderTests-1708844988 None] Lock "cinder-8ca14249-affc-47be-8181-aa8085b3f1e0-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:03 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.556s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:14:03 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (11fc3a3c-1acd-4442-a3f5-94dcd2f676c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44051b38-2749-407d-895a-8a2304134d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44051b38-2749-407d-895a-8a2304134d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299944801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:04Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3766d252-6686-4330-8939-aa18695f57ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3766d252-6686-4330-8939-aa18695f57ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d62d05-95c0-4fc0-9015-2107a5ff98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d62d05-95c0-4fc0-9015-2107a5ff98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46', 'volume_name': 'volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb49c0e-1038-44b4-b15e-eb2fbdd234c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb49c0e-1038-44b4-b15e-eb2fbdd234c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70575212-fad7-4095-b806-760710dccfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Volume f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46', 'volume_size': 1} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299944801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:04Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Creating volume f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:03 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:04 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 1073741824 Sep 01 02:14:04 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.341s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:04 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28 Sep 01 02:14:04 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:04 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee.3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-3dd2cd65-c2c6-4ba9-a2a7-9b3b13a65d28" released by "_delete_snapshot" :: held 1.633s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" released by "delete_snapshot" :: held 1.660s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:04 devstack cinder-volume[86925]: WARNING cinder.quota [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-786345724 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-786345724, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] Created reservations ['b17e6fd2-e6dc-4688-a8e7-217e55c0bd9a', '47dae8b8-cc8c-469e-9cef-d6fe23f4fb39', '43799899-288a-418d-8d50-e06c726cb6cf', 'd3c3669c-0098-49db-8019-22ada2d1dd7e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:04 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 1073741824" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-792544a1-0b9c-48f1-90ed-2705ec2c2cdc tempest-GroupSnapshotsTest-466359133 None] group_snapshot 9e28ea89-a728-4212-a70c-6ad613572f34: deleted successfully Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:04 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 Sep 01 02:14:04 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:04 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70575212-fad7-4095-b806-760710dccfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e07b49-0d31-4fed-84ee-40964e62522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Volume volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 (f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46): created successfully Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e07b49-0d31-4fed-84ee-40964e62522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (11fc3a3c-1acd-4442-a3f5-94dcd2f676c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d712e381-2d8f-47d3-b046-40b4a7a03e92 tempest-ProjectReaderTests-1708844988 None] Created volume successfully. Sep 01 02:14:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-quobyte-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdcaaf1-6a75-4d89-b8d7-c93154502830]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:05 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 Sep 01 02:14:05 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debda02-5fd7-4370-8231-01e4b814487e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:14:05 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46 Sep 01 02:14:05 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.382s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee Sep 01 02:14:05 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" returned: 0 in 0.257s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46" released by "delete_volume" :: held 0.687s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Created reservations ['3eecb542-e6b5-4ac2-a949-1484ccf792e9', 'b84e6835-2301-48f3-9857-7d8c1c8bf900', '120d8bdf-4a9f-4825-808f-6fb24c27532e', '814138e2-9caf-464e-90cf-1715771759c5'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:05 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f571df97-3e20-4ead-a30d-eb60701044ee" returned: 0 in 0.263s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-f571df97-3e20-4ead-a30d-eb60701044ee" released by "delete_volume" :: held 0.711s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['aaf9a43a-3464-4011-8862-9860926dadfa'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:06 devstack cinder-volume[86925]: WARNING cinder.db.api [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-786345724'] Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['ccc12650-afb7-4487-819d-eaa461622546', 'b01edbb7-77ff-4029-bdb2-fd6772524e13', '09c5007e-e9d6-4765-9e9d-b39101805ba6', '3dfa58f2-cf00-45e5-b73e-338656aad71f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:06 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Deleted volume successfully. Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-522ed997-ecb6-4ee1-9d50-5193e5c344f0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-f1cc1bd7-2e2b-4de1-b745-08d45f5ebd46-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:06 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:06 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.301s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-942fee0e-3df9-4975-a50b-192579116b97 tempest-GroupSnapshotsTest-466359133 None] Delete group completed successfully. Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (d869d3c8-0474-4cf7-a728-ee111b1c0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d86214-8638-44e6-988f-9466088603fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d86214-8638-44e6-988f-9466088603fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481628757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ba6284-c690-425e-ad8c-538be9194148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:07Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed128ca-3e3b-4bee-b97e-60f110541ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed128ca-3e3b-4bee-b97e-60f110541ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea1f6f3-80f7-446c-952f-ea22d5ba2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea1f6f3-80f7-446c-952f-ea22d5ba2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ba6284-c690-425e-ad8c-538be9194148', 'volume_name': 'volume-20ba6284-c690-425e-ad8c-538be9194148', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ec7c7-677f-470f-a00f-d95292704c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ec7c7-677f-470f-a00f-d95292704c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3dd9fa-8761-4551-869a-8a9f7a100f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Volume 20ba6284-c690-425e-ad8c-538be9194148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ba6284-c690-425e-ad8c-538be9194148', 'volume_size': 1} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481628757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ba6284-c690-425e-ad8c-538be9194148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c209a6bd2a40f389c2157b00e47d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:07Z,use_quota=True,user_id='9b7330e291ac4bb28bd8880cccec0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Creating volume 20ba6284-c690-425e-ad8c-538be9194148 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:06 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 1073741824 Sep 01 02:14:06 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6e02f9a5-2bbf-4cdd-bb00-cb287073bf91 tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-315858717: creating Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6e02f9a5-2bbf-4cdd-bb00-cb287073bf91 tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-315858717: created successfully Sep 01 02:14:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6e02f9a5-2bbf-4cdd-bb00-cb287073bf91 tempest-GroupSnapshotsTest-466359133 None] Create group completed successfully. Sep 01 02:14:07 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 1073741824" returned: 0 in 0.393s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 Sep 01 02:14:07 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3dd9fa-8761-4551-869a-8a9f7a100f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ba6284-c690-425e-ad8c-538be9194148', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d091c-25c4-4ae3-b636-f9b936f18dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Volume volume-20ba6284-c690-425e-ad8c-538be9194148 (20ba6284-c690-425e-ad8c-538be9194148): created successfully Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d091c-25c4-4ae3-b636-f9b936f18dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Flow 'volume_create_manager' (d869d3c8-0474-4cf7-a728-ee111b1c0929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5c9562f9-f258-4354-9051-b187d714592d tempest-ProjectReaderTests-1708844988 None] Created volume successfully. Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-20ba6284-c690-425e-ad8c-538be9194148-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-20ba6284-c690-425e-ad8c-538be9194148-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "cinder-quobyte-20ba6284-c690-425e-ad8c-538be9194148" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-20ba6284-c690-425e-ad8c-538be9194148" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f50c414-c4e2-456d-8b52-3fbaee938cba]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 Sep 01 02:14:07 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148" returned: 0 in 0.359s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148 Sep 01 02:14:08 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20ba6284-c690-425e-ad8c-538be9194148" returned: 0 in 0.293s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-quobyte-20ba6284-c690-425e-ad8c-538be9194148" released by "delete_volume" :: held 0.695s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (b598b46a-34ab-4dd2-be6c-c0cd3964882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a18cf7-4ac3-46e7-ada2-bd68240652a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a18cf7-4ac3-46e7-ada2-bd68240652a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-916045283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,host='devstack@QuobyteHD#QuobyteHD',id=e5421541-a84b-43b1-957d-1e9556165ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:08Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726115-bd11-4785-b9cf-2d361df5cd23),volume_type_id=64726115-bd11-4785-b9cf-2d361df5cd23)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be520b2c-9214-4e75-abbd-3c81eef6e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be520b2c-9214-4e75-abbd-3c81eef6e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f9f12-23ad-4678-a7a9-aaa92883030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f9f12-23ad-4678-a7a9-aaa92883030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5421541-a84b-43b1-957d-1e9556165ece', 'volume_name': 'volume-e5421541-a84b-43b1-957d-1e9556165ece', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026ec742-1cf1-43b5-a93f-204782f08b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026ec742-1cf1-43b5-a93f-204782f08b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec893305-562f-450c-ba40-cd7de01f6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:08 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Volume e5421541-a84b-43b1-957d-1e9556165ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5421541-a84b-43b1-957d-1e9556165ece', 'volume_size': 1} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,created_at=2026-09-01T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-916045283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,host='devstack@QuobyteHD#QuobyteHD',id=e5421541-a84b-43b1-957d-1e9556165ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:08Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726115-bd11-4785-b9cf-2d361df5cd23),volume_type_id=64726115-bd11-4785-b9cf-2d361df5cd23)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Creating volume e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:08 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece 1073741824 Sep 01 02:14:08 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Created reservations ['b26b5dbb-f656-420d-95be-2dfd2826437a', '81c528a5-3d7e-41dc-b94b-2d14342843fc', '4fde07fc-4771-4a5f-9369-0f3750cdd4b9', '37799db2-610e-4fdf-8e90-6a6e6af9cbf4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:08 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Deleted volume successfully. Sep 01 02:14:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b04865f7-56de-4a7c-ace2-c181626a4ac0 tempest-ProjectReaderTests-1708844988 None] Lock "cinder-20ba6284-c690-425e-ad8c-538be9194148-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:09 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece 1073741824" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece Sep 01 02:14:09 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec893305-562f-450c-ba40-cd7de01f6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5421541-a84b-43b1-957d-1e9556165ece', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e155c-ad68-4740-86ef-5587e4fc8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:09 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Volume volume-e5421541-a84b-43b1-957d-1e9556165ece (e5421541-a84b-43b1-957d-1e9556165ece): created successfully Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e155c-ad68-4740-86ef-5587e4fc8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (b598b46a-34ab-4dd2-be6c-c0cd3964882a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-af01e318-6655-4d97-a970-f251d6752203 tempest-GroupSnapshotsTest-466359133 None] Created volume successfully. Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (2591fb93-da82-434f-81ae-66114a07546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2507fb-06a6-43a3-bd11-4563941588f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2507fb-06a6-43a3-bd11-4563941588f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913063115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,host='devstack@QuobyteHD#QuobyteHD',id=0d780cd0-daad-4a33-be9d-77031d99ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:10Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726115-bd11-4785-b9cf-2d361df5cd23),volume_type_id=64726115-bd11-4785-b9cf-2d361df5cd23)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbaa81b-891a-45f5-86de-9aa8161705a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbaa81b-891a-45f5-86de-9aa8161705a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f9d82a-5246-4a6e-ab38-d2907711446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f9d82a-5246-4a6e-ab38-d2907711446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d780cd0-daad-4a33-be9d-77031d99ca10', 'volume_name': 'volume-0d780cd0-daad-4a33-be9d-77031d99ca10', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93298fc1-cb37-448c-b439-5cdcaf9c133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93298fc1-cb37-448c-b439-5cdcaf9c133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b7eb02-aab4-4168-ade3-39c641c70a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Volume 0d780cd0-daad-4a33-be9d-77031d99ca10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d780cd0-daad-4a33-be9d-77031d99ca10', 'volume_size': 1} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,created_at=2026-09-01T00:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913063115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34ea7fbb-fede-4a75-9c36-1e903c08a843,host='devstack@QuobyteHD#QuobyteHD',id=0d780cd0-daad-4a33-be9d-77031d99ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:10Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726115-bd11-4785-b9cf-2d361df5cd23),volume_type_id=64726115-bd11-4785-b9cf-2d361df5cd23)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Creating volume 0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:10 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 1073741824 Sep 01 02:14:10 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:10 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 1073741824" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=167,cinder:INSERT=46,cinder:UPDATE=202,cinder:DELETE=16 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 Sep 01 02:14:10 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:11 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b7eb02-aab4-4168-ade3-39c641c70a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d780cd0-daad-4a33-be9d-77031d99ca10', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf918561-dbd0-4dbb-835d-639e1487dc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Volume volume-0d780cd0-daad-4a33-be9d-77031d99ca10 (0d780cd0-daad-4a33-be9d-77031d99ca10): created successfully Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf918561-dbd0-4dbb-835d-639e1487dc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (2591fb93-da82-434f-81ae-66114a07546e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9f8c6cc0-ab12-4d6d-8416-22931ec0bad4 tempest-GroupSnapshotsTest-466359133 None] Created volume successfully. Sep 01 02:14:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-31cb4fa5-3aef-4310-835e-4bef14a71700 tempest-GroupSnapshotsTest-466359133 None] Update group completed successfully. Sep 01 02:14:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-120d0a5e-973c-41da-b875-d50b9e43f609 tempest-GroupSnapshotsTest-466359133 None] Update group completed successfully. Sep 01 02:14:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2ba491f9-5d86-4f96-a09f-08b6dc1be3be tempest-GroupSnapshotsTest-466359133 None] Update group completed successfully. Sep 01 02:14:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d6211809-1d18-4d3d-87bc-1f1bb1ce8e90 tempest-GroupSnapshotsTest-466359133 None] Update group completed successfully. Sep 01 02:14:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] GroupSnapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: creating. Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Group snapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: creating. {{(pid=86925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Creating offline snapshot 174b8d56-89ed-4814-902c-658db4e1b60c of volume e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfccbb6-d705-4afc-a31a-e2089c51e730]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:16 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece Sep 01 02:14:16 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:16 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece" returned: 0 in 0.351s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:16 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c 1G Sep 01 02:14:16 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c 1G" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5421541-a84b-43b1-957d-1e9556165ece -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5421541-a84b-43b1-957d-1e9556165ece -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c Sep 01 02:14:17 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5421541-a84b-43b1-957d-1e9556165ece -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c" returned: 0 in 0.284s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c Sep 01 02:14:17 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info Sep 01 02:14:17 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info" returned: 0 in 0.285s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info Sep 01 02:14:18 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.info" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Creating offline snapshot ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 of volume 0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f83b9-9343-4507-bf6a-d96c3d338486]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 Sep 01 02:14:18 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 1G Sep 01 02:14:18 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 1G" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d780cd0-daad-4a33-be9d-77031d99ca10 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d780cd0-daad-4a33-be9d-77031d99ca10 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 Sep 01 02:14:19 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d780cd0-daad-4a33-be9d-77031d99ca10 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" returned: 0 in 0.320s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 Sep 01 02:14:19 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info Sep 01 02:14:19 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info" returned: 0 in 0.265s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info Sep 01 02:14:20 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.info" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a3b6ca5c-b05d-4b4d-93e8-5b351c1ccda1 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: created successfully Sep 01 02:14:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: deleting Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: deleting {{(pid=86925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-174b8d56-89ed-4814-902c-658db4e1b60c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-174b8d56-89ed-4814-902c-658db4e1b60c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Deleting offline snapshot 174b8d56-89ed-4814-902c-658db4e1b60c of volume e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] snapshot_file for this snap is: volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8d3375-bb0b-4c96-a152-a4c6a0a025ad]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c Sep 01 02:14:21 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c" returned: 0 in 0.431s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5421541-a84b-43b1-957d-1e9556165ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b51179-e043-4788-94f1-42828e6dc0b6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece Sep 01 02:14:21 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c Sep 01 02:14:21 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c" returned: 0 in 0.364s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c Sep 01 02:14:22 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece.174b8d56-89ed-4814-902c-658db4e1b60c" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-174b8d56-89ed-4814-902c-658db4e1b60c" released by "_delete_snapshot" :: held 1.545s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" released by "delete_snapshot" :: held 1.568s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Deleting offline snapshot ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 of volume 0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] snapshot_file for this snap is: volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e3d300-5d15-4a33-8c52-d66ef5f32f34]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 Sep 01 02:14:22 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d780cd0-daad-4a33-be9d-77031d99ca10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fcbac2-23d9-42eb-8ccf-1589757bc16c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:23 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 Sep 01 02:14:23 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10" returned: 0 in 0.355s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:23 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 Sep 01 02:14:23 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" returned: 0 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:23 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0 Sep 01 02:14:23 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10.ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-ce6437e3-e8c1-44c0-bd6a-19146db1a4b0" released by "_delete_snapshot" :: held 1.391s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" released by "delete_snapshot" :: held 1.414s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:24 devstack cinder-volume[86925]: WARNING cinder.quota [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1424196232 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1424196232, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:24 devstack cinder-volume[86925]: WARNING cinder.quota [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1424196232 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1424196232, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['8daa6959-e182-40a0-8a9c-b0f472775426', '7bdb0cbf-64e2-4644-b641-cc5652b1e525', '96022792-07a1-4918-8e96-71ba8eb09c14', '926b6cb7-6f88-4183-8ce5-f1f30433c0bd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['661320f2-c322-45c2-9f4d-106e745f5d2c', 'd1b6d5bb-e48b-4251-ade5-897ea04bc340', '0700364d-7a7c-4499-a97f-98833b3fb0f3', '800dc1ee-d17f-4662-b096-e68ff0531485'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aa517a63-c3ee-4b15-90cd-b71dbf0a6a20 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 79a4153f-b519-4609-96f7-d9cb16eaa930: deleted successfully Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f9e84-7baf-406d-baf2-56f1471cb7c6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 Sep 01 02:14:24 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10" returned: 0 in 0.397s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10 Sep 01 02:14:25 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0d780cd0-daad-4a33-be9d-77031d99ca10" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-0d780cd0-daad-4a33-be9d-77031d99ca10" released by "delete_volume" :: held 0.716s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d2e2a-3e13-458f-9673-c6d78183c053]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece Sep 01 02:14:25 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece" returned: 0 in 0.361s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece Sep 01 02:14:25 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e5421541-a84b-43b1-957d-1e9556165ece" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-e5421541-a84b-43b1-957d-1e9556165ece" released by "delete_volume" :: held 0.665s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['0ba344db-2be2-4049-8333-67257f5aa442'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:26 devstack cinder-volume[86925]: WARNING cinder.quota [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1424196232 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1424196232, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['b8c43c0b-534b-43d1-9345-cf63b1f77e3b', 'a4d9b743-42bf-4a9d-9361-71122d4af729', '987a297c-cffd-451f-9fe0-8d9c20b8cbbf', 'ea4639ab-e019-4e3f-ae8b-1b0ed98716f2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Created reservations ['f039b703-d87f-4772-a364-9c72a3ff1101', '814f367d-232b-4690-b7e4-4a895f680789', '967ded75-bb49-46f6-a1be-9d8034d9c2ab', '4baa343c-e7c6-4587-ad39-a9230e244046'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:26 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c18553db-5f0c-4131-92c5-80c2b585cf80 tempest-GroupSnapshotsTest-466359133 None] Delete group completed successfully. Sep 01 02:14:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-95618eb5-6629-4930-a0c8-d2324bf89d8b tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-729091969: creating Sep 01 02:14:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-95618eb5-6629-4930-a0c8-d2324bf89d8b tempest-GroupSnapshotsTest-466359133 None] Group tempest-GroupSnapshotsTest-Group-729091969: created successfully Sep 01 02:14:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-95618eb5-6629-4930-a0c8-d2324bf89d8b tempest-GroupSnapshotsTest-466359133 None] Create group completed successfully. Sep 01 02:14:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (25a20219-c9b2-4654-ab9a-045d30ec8aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ad0865-ba85-414f-a306-598a2f5ed887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ad0865-ba85-414f-a306-598a2f5ed887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524496982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb8bf35d-17e2-4a1e-9dfe-d529bed1a00b,host='devstack@QuobyteHD#QuobyteHD',id=b16d14cd-e993-4651-9e8f-f16a1aada028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:29Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71f283f2-d394-47c9-84e9-6a05a3672ce4),volume_type_id=71f283f2-d394-47c9-84e9-6a05a3672ce4)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75da4a51-0197-467a-a3fa-91fa2f5e3784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75da4a51-0197-467a-a3fa-91fa2f5e3784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e893ee9-3035-48e8-86eb-62368986971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e893ee9-3035-48e8-86eb-62368986971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16d14cd-e993-4651-9e8f-f16a1aada028', 'volume_name': 'volume-b16d14cd-e993-4651-9e8f-f16a1aada028', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce9da9c-e9e8-4430-bf43-59c3f5c89b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce9da9c-e9e8-4430-bf43-59c3f5c89b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bae8925-c83c-41da-b340-02fbb793a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Volume b16d14cd-e993-4651-9e8f-f16a1aada028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16d14cd-e993-4651-9e8f-f16a1aada028', 'volume_size': 1} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb8bf35d-17e2-4a1e-9dfe-d529bed1a00b,created_at=2026-09-01T00:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524496982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb8bf35d-17e2-4a1e-9dfe-d529bed1a00b,host='devstack@QuobyteHD#QuobyteHD',id=b16d14cd-e993-4651-9e8f-f16a1aada028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fc715df4bb48f6991133ab6be72a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:29Z,use_quota=True,user_id='b9d68336296c428e8f711272afe09b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71f283f2-d394-47c9-84e9-6a05a3672ce4),volume_type_id=71f283f2-d394-47c9-84e9-6a05a3672ce4)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Creating volume b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:29 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 1073741824 Sep 01 02:14:29 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 1073741824" returned: 0 in 0.404s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 Sep 01 02:14:29 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bae8925-c83c-41da-b340-02fbb793a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16d14cd-e993-4651-9e8f-f16a1aada028', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc381d78-4e88-46f9-b4af-f8ac7704a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Volume volume-b16d14cd-e993-4651-9e8f-f16a1aada028 (b16d14cd-e993-4651-9e8f-f16a1aada028): created successfully Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc381d78-4e88-46f9-b4af-f8ac7704a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Flow 'volume_create_manager' (25a20219-c9b2-4654-ab9a-045d30ec8aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-09dbcb06-4206-48ec-9b60-7e0ed2788043 tempest-GroupSnapshotsTest-466359133 None] Created volume successfully. Sep 01 02:14:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] GroupSnapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: creating. Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Group snapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: creating. {{(pid=86925) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Creating offline snapshot 5593fe2d-7690-4d55-a245-bd6629e74578 of volume b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[355429bf-4c62-41ee-bace-97905cd4c2a7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 Sep 01 02:14:30 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 1G Sep 01 02:14:30 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 1G" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16d14cd-e993-4651-9e8f-f16a1aada028 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16d14cd-e993-4651-9e8f-f16a1aada028 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 Sep 01 02:14:31 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16d14cd-e993-4651-9e8f-f16a1aada028 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 Sep 01 02:14:31 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info Sep 01 02:14:31 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info" returned: 0 in 0.257s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:14:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info Sep 01 02:14:31 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:32 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.info" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-55dc261b-b60e-41c9-bee5-c6305e2498a9 tempest-GroupSnapshotsTest-466359133 None] group_snapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: created successfully Sep 01 02:14:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] group_snapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: deleting Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] group_snapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: deleting {{(pid=86925) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-5593fe2d-7690-4d55-a245-bd6629e74578" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-5593fe2d-7690-4d55-a245-bd6629e74578" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Deleting offline snapshot 5593fe2d-7690-4d55-a245-bd6629e74578 of volume b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] snapshot_file for this snap is: volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9db1aa-05ca-45d4-94a7-27226a93ce1c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:32 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 Sep 01 02:14:32 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:33 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578" returned: 0 in 0.373s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16d14cd-e993-4651-9e8f-f16a1aada028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd336b-e0ac-4b11-b349-7dd074c6738a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:33 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 Sep 01 02:14:33 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:33 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:33 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 Sep 01 02:14:33 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:33 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578" returned: 0 in 0.387s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:33 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578 Sep 01 02:14:33 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:34 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028.5593fe2d-7690-4d55-a245-bd6629e74578" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-5593fe2d-7690-4d55-a245-bd6629e74578" released by "_delete_snapshot" :: held 1.453s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" released by "delete_snapshot" :: held 1.479s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:34 devstack cinder-volume[86925]: WARNING cinder.quota [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2139710426 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2139710426, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:34 devstack cinder-volume[86925]: WARNING cinder.quota [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2139710426 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2139710426, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:34 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] Created reservations ['1af98d8e-e8a0-4dfc-aad6-d3567206bfd3', '3e3486e5-6a64-439c-80c0-c45630253b05', 'a5b98ac9-ebe2-4464-8172-5e7b4e3ecb2c', '71956447-d688-485f-87a8-49b5f7ac2bb5'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d1be8870-f31d-40a8-bd81-6c366222e14b tempest-GroupSnapshotsTest-466359133 None] group_snapshot 1cf1074d-1a76-4883-9b19-510fccf1b209: deleted successfully Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e4cf51-2323-41a1-bb3d-4866dac9cdd1]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:35 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 Sep 01 02:14:35 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:35 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:35 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028 Sep 01 02:14:35 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:35 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b16d14cd-e993-4651-9e8f-f16a1aada028" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Lock "cinder-quobyte-b16d14cd-e993-4651-9e8f-f16a1aada028" released by "delete_volume" :: held 0.661s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Created reservations ['c45093fc-8a73-49ee-bb34-13233752eff7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:35 devstack cinder-volume[86925]: WARNING cinder.quota [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2139710426 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2139710426, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Created reservations ['1494477d-fc64-4d7e-84a5-eb1272631ba7', 'd5244609-02de-40ce-a880-e8075350087b', '3868950a-9a2f-46d0-9b8c-5d39c83d2c92', 'ac0f7acf-f878-43ed-b2b5-757d3031f7b8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:36 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:36 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:36 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:36 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3d995add-635e-45e0-ae99-dc317804576d tempest-GroupSnapshotsTest-466359133 None] Delete group completed successfully. Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:40 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:40 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:41 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:14:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:14:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-33542e93-16ab-49cb-877e-b75846124572 tempest-GroupsTest-2086068325 None] Group tempest-Group1-500149175: creating Sep 01 02:14:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-33542e93-16ab-49cb-877e-b75846124572 tempest-GroupsTest-2086068325 None] Group tempest-Group1-500149175: created successfully Sep 01 02:14:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-33542e93-16ab-49cb-877e-b75846124572 tempest-GroupsTest-2086068325 None] Create group completed successfully. Sep 01 02:14:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ab55e68-3e30-42c0-ba18-b0b0798e87d8 tempest-GroupsTest-2086068325 None] Group tempest-Group2-1530632561: creating Sep 01 02:14:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ab55e68-3e30-42c0-ba18-b0b0798e87d8 tempest-GroupsTest-2086068325 None] Group tempest-Group2-1530632561: created successfully Sep 01 02:14:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ab55e68-3e30-42c0-ba18-b0b0798e87d8 tempest-GroupsTest-2086068325 None] Create group completed successfully. Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (d75d4946-0beb-4131-8c23-ddba99bd6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f899ba33-4504-4508-a140-13c03146ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f899ba33-4504-4508-a140-13c03146ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567160024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be2ff8e1-8ef8-44f9-bd0e-81f70afa76fd,host='devstack@QuobyteHD#QuobyteHD',id=5c704e22-2c1c-440d-967c-0be22c4ff3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41a067d2-d796-40c5-bd1d-4ae85de15053),volume_type_id=41a067d2-d796-40c5-bd1d-4ae85de15053)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179389c7-c53b-4317-b77f-6ca3cea64926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179389c7-c53b-4317-b77f-6ca3cea64926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddc48e5-7678-41d0-97bf-2d8c004088fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddc48e5-7678-41d0-97bf-2d8c004088fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c704e22-2c1c-440d-967c-0be22c4ff3aa', 'volume_name': 'volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c3be6-ebc6-4597-b55f-b13d67881ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c3be6-ebc6-4597-b55f-b13d67881ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7e7c96-525f-4dc5-8abc-65df2fe45fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Volume 5c704e22-2c1c-440d-967c-0be22c4ff3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa', 'volume_size': 1} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be2ff8e1-8ef8-44f9-bd0e-81f70afa76fd,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567160024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be2ff8e1-8ef8-44f9-bd0e-81f70afa76fd,host='devstack@QuobyteHD#QuobyteHD',id=5c704e22-2c1c-440d-967c-0be22c4ff3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41a067d2-d796-40c5-bd1d-4ae85de15053),volume_type_id=41a067d2-d796-40c5-bd1d-4ae85de15053)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Creating volume 5c704e22-2c1c-440d-967c-0be22c4ff3aa {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:44 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:44 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa 1073741824 Sep 01 02:14:44 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:44 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa 1073741824" returned: 0 in 0.397s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:44 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa Sep 01 02:14:44 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:44 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7e7c96-525f-4dc5-8abc-65df2fe45fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d9dd8b-21b2-4552-a646-7e9fb02f9df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Volume volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa (5c704e22-2c1c-440d-967c-0be22c4ff3aa): created successfully Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d9dd8b-21b2-4552-a646-7e9fb02f9df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (d75d4946-0beb-4131-8c23-ddba99bd6be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e90975df-45d1-4d9c-b9ac-7fe116469113 tempest-GroupsTest-2086068325 None] Created volume successfully. Sep 01 02:14:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Acquiring lock "cinder-quobyte-5c704e22-2c1c-440d-967c-0be22c4ff3aa" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-5c704e22-2c1c-440d-967c-0be22c4ff3aa" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffbe1b7-8ff1-4777-8a6d-35cb4055a420]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:45 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa Sep 01 02:14:45 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa" returned: 0 in 0.356s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:46 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa Sep 01 02:14:46 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5c704e22-2c1c-440d-967c-0be22c4ff3aa" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-5c704e22-2c1c-440d-967c-0be22c4ff3aa" released by "delete_volume" :: held 0.636s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Created reservations ['3b6b143b-5206-4eee-807c-7141daa6f7c3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:46 devstack cinder-volume[86925]: WARNING cinder.quota [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1616245241 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1616245241, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:46 devstack cinder-volume[86925]: WARNING cinder.quota [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1616245241 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1616245241, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Created reservations ['65a8e30f-2df6-45cc-bd4c-febb8803dd92', '44e4fe31-d945-4ca7-bf1f-58aef9de723d', '9485cf32-e21d-4b24-a4af-7d3bf5352b74', '1bf72e81-97e2-4ddb-b8fb-36df703422f2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:46 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:46 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-14b0d49f-89ec-4fde-9ec0-f05a3ee2fda8 tempest-GroupsTest-2086068325 None] Delete group completed successfully. Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Created reservations ['161ed4d3-82a1-4106-b74a-28c6e08cb2d7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:47 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:47 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:47 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:47 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-13ab864f-c892-4070-a74e-532780326794 tempest-GroupsTest-2086068325 None] Delete group completed successfully. Sep 01 02:14:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b34e1f83-c630-4ae9-94de-6fb78017739a tempest-GroupsTest-2086068325 None] Group tempest-GroupsTest-Group-475882151: creating Sep 01 02:14:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b34e1f83-c630-4ae9-94de-6fb78017739a tempest-GroupsTest-2086068325 None] Group tempest-GroupsTest-Group-475882151: created successfully Sep 01 02:14:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b34e1f83-c630-4ae9-94de-6fb78017739a tempest-GroupsTest-2086068325 None] Create group completed successfully. Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (0c12a841-5eb1-43b7-a41b-fde828a1c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae77c5f-97b7-4f0c-a494-95723b126bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae77c5f-97b7-4f0c-a494-95723b126bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1524267824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7db086da-d00e-4e3d-822e-765c5c42862c,host='devstack@QuobyteHD#QuobyteHD',id=9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:50Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b723d3b5-9cc5-420a-b691-f9c7dde1f57e),volume_type_id=b723d3b5-9cc5-420a-b691-f9c7dde1f57e)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2cf86f-b0ac-43d8-8267-3ab966896740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2cf86f-b0ac-43d8-8267-3ab966896740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b8ce8e-5fc8-4db7-aa6e-cd8c27e53e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b8ce8e-5fc8-4db7-aa6e-cd8c27e53e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7', 'volume_name': 'volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d49b70-5bf4-4a68-ab7c-dc571b0c5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d49b70-5bf4-4a68-ab7c-dc571b0c5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab6712-c5f9-4894-bdb9-c906320f6281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Volume 9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7', 'volume_size': 1} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7db086da-d00e-4e3d-822e-765c5c42862c,created_at=2026-09-01T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1524267824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7db086da-d00e-4e3d-822e-765c5c42862c,host='devstack@QuobyteHD#QuobyteHD',id=9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:50Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b723d3b5-9cc5-420a-b691-f9c7dde1f57e),volume_type_id=b723d3b5-9cc5-420a-b691-f9c7dde1f57e)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Creating volume 9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:50 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:50 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 1073741824 Sep 01 02:14:50 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:50 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 1073741824" returned: 0 in 0.418s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:50 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 Sep 01 02:14:50 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab6712-c5f9-4894-bdb9-c906320f6281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012cf4e8-9153-454d-a005-44c44791e33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Volume volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 (9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7): created successfully Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012cf4e8-9153-454d-a005-44c44791e33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (0c12a841-5eb1-43b7-a41b-fde828a1c863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f761e2ff-85e2-4c6e-b38c-5adaecc09fd6 tempest-GroupsTest-2086068325 None] Created volume successfully. Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (d0498a43-e264-4fbc-b073-302b6de66284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1f9cf4-f233-4f73-938c-3fb7ee4953c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1f9cf4-f233-4f73-938c-3fb7ee4953c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1494955868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7db086da-d00e-4e3d-822e-765c5c42862c,host='devstack@QuobyteHD#QuobyteHD',id=1b218d18-68d9-4c80-b043-a1b9eb0e96b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:52Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b723d3b5-9cc5-420a-b691-f9c7dde1f57e),volume_type_id=b723d3b5-9cc5-420a-b691-f9c7dde1f57e)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2819aac7-2e5b-4e99-ad5e-7ccde7cb827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2819aac7-2e5b-4e99-ad5e-7ccde7cb827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672657e-37dc-4bf3-95e8-624b4104a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672657e-37dc-4bf3-95e8-624b4104a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b218d18-68d9-4c80-b043-a1b9eb0e96b9', 'volume_name': 'volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749e3255-641c-4c07-a0c5-a44739589157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749e3255-641c-4c07-a0c5-a44739589157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053d94c8-5ca8-4e55-bb65-d76f2bb637fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Volume 1b218d18-68d9-4c80-b043-a1b9eb0e96b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9', 'volume_size': 1} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7db086da-d00e-4e3d-822e-765c5c42862c,created_at=2026-09-01T00:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1494955868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7db086da-d00e-4e3d-822e-765c5c42862c,host='devstack@QuobyteHD#QuobyteHD',id=1b218d18-68d9-4c80-b043-a1b9eb0e96b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3da4721233413d9c9a4137ab824705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:52Z,use_quota=True,user_id='542a31b1223049538e268f48c5b68437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b723d3b5-9cc5-420a-b691-f9c7dde1f57e),volume_type_id=b723d3b5-9cc5-420a-b691-f9c7dde1f57e)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Creating volume 1b218d18-68d9-4c80-b043-a1b9eb0e96b9 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:52 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 1073741824 Sep 01 02:14:52 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 1073741824" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 Sep 01 02:14:52 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053d94c8-5ca8-4e55-bb65-d76f2bb637fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058d960c-c19e-4ed4-9c0e-04f90212d938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Volume volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 (1b218d18-68d9-4c80-b043-a1b9eb0e96b9): created successfully Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058d960c-c19e-4ed4-9c0e-04f90212d938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Flow 'volume_create_manager' (d0498a43-e264-4fbc-b073-302b6de66284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-56a5c755-06ea-41e7-bca1-f957af9a7a7f tempest-GroupsTest-2086068325 None] Created volume successfully. Sep 01 02:14:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f3478c81-4d35-4c6f-bb8f-857f49a3bd16 tempest-GroupsTest-2086068325 None] Update group completed successfully. Sep 01 02:14:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-768e986d-d62d-4195-9cca-b09afbdc26a3 tempest-GroupsTest-2086068325 None] Update group completed successfully. Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Acquiring lock "cinder-quobyte-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00b263-2f78-4af4-b0ee-b03a8e23a090]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 Sep 01 02:14:56 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" returned: 0 in 0.356s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9 Sep 01 02:14:56 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" returned: 0 in 0.237s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-1b218d18-68d9-4c80-b043-a1b9eb0e96b9" released by "delete_volume" :: held 0.631s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Acquiring lock "cinder-quobyte-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36fcf5d-3800-47b3-b6dc-e4fd7e534cef]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 Sep 01 02:14:56 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:57 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:57 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7 Sep 01 02:14:57 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:57 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "cinder-quobyte-9dfc2343-a59e-4f6d-a9f1-ad37d3ff91a7" released by "delete_volume" :: held 0.646s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Created reservations ['5b85679c-06e4-40a3-a95e-7fc84d6210fd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:57 devstack cinder-volume[86925]: WARNING cinder.quota [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1602286267 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1602286267, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:57 devstack cinder-volume[86925]: WARNING cinder.quota [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1602286267 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1602286267, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Created reservations ['2d126312-2b3b-4ade-b74d-c977723ab2a4', '99e5c957-abd3-4015-9b64-10bc13580368', '389ed84a-a927-4cdb-8097-59d22a895181', '418dd168-a771-4b6e-a680-8ba98420e2cd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Created reservations ['80dadd55-3e11-4b9b-82a1-695fc58eeaf4', '699d68d4-1bad-427f-b9c3-2bfbcf0b1081', '8ef511fb-09a9-4c5f-aa5b-14800a2b7e31', 'fa6df15f-e3b0-4869-8635-84422a53b76c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:57 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:14:57 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:58 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2fc94198-8cbd-4c3e-bea1-5780564f9e1e tempest-GroupsTest-2086068325 None] Delete group completed successfully. Sep 01 02:15:07 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=105,cinder:DELETE=1,cinder:SELECT=107,cinder:INSERT=25 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:07 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=155,cinder:UPDATE=176,cinder:INSERT=40,cinder:DELETE=7 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Flow 'volume_create_manager' (0e7897dd-9f29-4164-9801-862fb293380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea1dd7d-9f4f-404c-8b89-a3aa2e4ef0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea1dd7d-9f4f-404c-8b89-a3aa2e4ef0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-841929374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d832a0b-6aad-458b-ba5f-89599bec14f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e35bf9624474edc8ab25e02a509e180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:11Z,use_quota=True,user_id='ca2b93a3a55142868f30bc42f325fa67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d2111c-e841-41de-bdd7-ab660cfc4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d2111c-e841-41de-bdd7-ab660cfc4497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbba30e-0697-4522-9b83-93743b665969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbba30e-0697-4522-9b83-93743b665969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d832a0b-6aad-458b-ba5f-89599bec14f1', 'volume_name': 'volume-3d832a0b-6aad-458b-ba5f-89599bec14f1', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65ccfdc-fcb3-4cd5-a2c0-6a51f98cb34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65ccfdc-fcb3-4cd5-a2c0-6a51f98cb34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c338633-0ef1-43ca-88dd-2cead98edb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Volume 3d832a0b-6aad-458b-ba5f-89599bec14f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d832a0b-6aad-458b-ba5f-89599bec14f1', 'volume_size': 1} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-841929374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d832a0b-6aad-458b-ba5f-89599bec14f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e35bf9624474edc8ab25e02a509e180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:11Z,use_quota=True,user_id='ca2b93a3a55142868f30bc42f325fa67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Creating volume 3d832a0b-6aad-458b-ba5f-89599bec14f1 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:11 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:11 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 1073741824 Sep 01 02:15:11 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:11 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 1073741824" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 Sep 01 02:15:12 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c338633-0ef1-43ca-88dd-2cead98edb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d832a0b-6aad-458b-ba5f-89599bec14f1', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e6193-1295-42bf-aacd-ac440148137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Volume volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 (3d832a0b-6aad-458b-ba5f-89599bec14f1): created successfully Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e6193-1295-42bf-aacd-ac440148137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Flow 'volume_create_manager' (0e7897dd-9f29-4164-9801-862fb293380c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c18438d1-a63d-452d-828f-feac29b1996b tempest-VolumesServicesTestJSON-645562118 None] Created volume successfully. Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Acquiring lock "cinder-3d832a0b-6aad-458b-ba5f-89599bec14f1-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "cinder-3d832a0b-6aad-458b-ba5f-89599bec14f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Acquiring lock "cinder-quobyte-3d832a0b-6aad-458b-ba5f-89599bec14f1" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "cinder-quobyte-3d832a0b-6aad-458b-ba5f-89599bec14f1" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd6cab-002f-427d-a2d9-88cc08950abd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 Sep 01 02:15:12 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:13 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1" returned: 0 in 0.359s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:13 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1 Sep 01 02:15:13 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:13 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3d832a0b-6aad-458b-ba5f-89599bec14f1" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "cinder-quobyte-3d832a0b-6aad-458b-ba5f-89599bec14f1" released by "delete_volume" :: held 0.636s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Created reservations ['106200d2-8932-4e4f-90a7-093eb8711a91', 'fb0e4830-ed4f-4d71-9d79-2784863221d3', 'b6ea1728-49e8-427f-af7c-a814cb448855', 'b5aeff8a-ec8d-4e44-bcb4-75faeccc8d4c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:13 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:15:13 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:13 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.265s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Deleted volume successfully. Sep 01 02:15:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4833fe00-2403-4f46-9c63-f68318fb2ee6 tempest-VolumesServicesTestJSON-645562118 None] Lock "cinder-3d832a0b-6aad-458b-ba5f-89599bec14f1-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:23 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:23 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:40 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:15:40 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:41 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:15:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (4f768893-837b-4fed-b4a9-87048d497512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78da7aa9-a4b4-473a-ad65-b375288e8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78da7aa9-a4b4-473a-ad65-b375288e8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2118816809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9625dc26-a7cb-43d6-8b79-67296c782a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:48Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05989fc-dd21-4e0e-8a47-81d3b7dc4063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05989fc-dd21-4e0e-8a47-81d3b7dc4063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21e3a5d-3437-490e-8668-243836eed6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21e3a5d-3437-490e-8668-243836eed6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9625dc26-a7cb-43d6-8b79-67296c782a55', 'volume_name': 'volume-9625dc26-a7cb-43d6-8b79-67296c782a55', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adc07a5-9a54-4462-8348-215ff0c8b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adc07a5-9a54-4462-8348-215ff0c8b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e4ab3b-a8f1-471b-879b-3f0d6b4ab86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Volume 9625dc26-a7cb-43d6-8b79-67296c782a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9625dc26-a7cb-43d6-8b79-67296c782a55', 'volume_size': 1} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2118816809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9625dc26-a7cb-43d6-8b79-67296c782a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:48Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Creating volume 9625dc26-a7cb-43d6-8b79-67296c782a55 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:48 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:48 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 1073741824 Sep 01 02:15:48 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:48 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 1073741824" returned: 0 in 0.419s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:48 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 Sep 01 02:15:48 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:49 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e4ab3b-a8f1-471b-879b-3f0d6b4ab86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9625dc26-a7cb-43d6-8b79-67296c782a55', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7749e020-e058-4664-a9db-567b3a2a17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:49 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Volume volume-9625dc26-a7cb-43d6-8b79-67296c782a55 (9625dc26-a7cb-43d6-8b79-67296c782a55): created successfully Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7749e020-e058-4664-a9db-567b3a2a17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (4f768893-837b-4fed-b4a9-87048d497512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9e13b723-cead-4bab-b0d9-dd371463fbe2 tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ba29c131-6a1c-4368-b946-b64e24d49a09 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55" by "attach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ba29c131-6a1c-4368-b946-b64e24d49a09 tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55" acquired by "attach_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ba29c131-6a1c-4368-b946-b64e24d49a09 tempest-VolumesActionsTest-1906727135 None] Attaching volume 9625dc26-a7cb-43d6-8b79-67296c782a55 to instance f5b2a11b-1a94-4afb-8922-e82ba8c01ee0 at mountpoint /dev/vdb on host None. Sep 01 02:15:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ba29c131-6a1c-4368-b946-b64e24d49a09 tempest-VolumesActionsTest-1906727135 None] Attach volume completed successfully. Sep 01 02:15:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ba29c131-6a1c-4368-b946-b64e24d49a09 tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55" released by "attach_volume" :: held 0.088s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Terminate volume connection completed successfully. Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" by "detach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Detaching volume 9625dc26-a7cb-43d6-8b79-67296c782a55 from instance f5b2a11b-1a94-4afb-8922-e82ba8c01ee0. Sep 01 02:15:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Detach volume completed successfully. Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-07715dec-a9a0-425b-bd32-a79a0f85807b tempest-VolumesActionsTest-473730501 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b825aa5-6513-428c-8f33-9b15656594b6 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" by "detach_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b825aa5-6513-428c-8f33-9b15656594b6 tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8b825aa5-6513-428c-8f33-9b15656594b6 tempest-VolumesActionsTest-1906727135 None] Volume detach called, but volume not attached. Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b825aa5-6513-428c-8f33-9b15656594b6 tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-quobyte-9625dc26-a7cb-43d6-8b79-67296c782a55" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "cinder-quobyte-9625dc26-a7cb-43d6-8b79-67296c782a55" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224d624-b8a4-4b50-a731-8aa9578b6a5e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 Sep 01 02:15:50 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55 Sep 01 02:15:50 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-9625dc26-a7cb-43d6-8b79-67296c782a55" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "cinder-quobyte-9625dc26-a7cb-43d6-8b79-67296c782a55" released by "delete_volume" :: held 0.677s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Created reservations ['b4b733ea-2209-4bb8-bebf-b0c602cdf42a', '621344f9-62cf-480d-9ba6-d6dc3d994c53', '37168b51-87a2-4ec3-add4-5e6518e443ed', '10cae850-8b4a-4161-964e-8a736d002095'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:51 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:15:51 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Deleted volume successfully. Sep 01 02:15:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-420b3983-e890-406b-99a2-0bcff6eaf01b tempest-VolumesActionsTest-1906727135 None] Lock "cinder-9625dc26-a7cb-43d6-8b79-67296c782a55-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (aa908fc6-7229-4c96-8479-b7ecffed7fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf710801-0bd2-4bbf-bebc-9335b27cac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf710801-0bd2-4bbf-bebc-9335b27cac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1896174257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8565ccb-9a82-4efb-8f73-f108b5cef35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:55Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3669be3-da2d-4863-8377-6ab5da7d208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3669be3-da2d-4863-8377-6ab5da7d208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabc507-e41d-4836-a083-17b03504ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabc507-e41d-4836-a083-17b03504ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8565ccb-9a82-4efb-8f73-f108b5cef35e', 'volume_name': 'volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9a5eba-3bc7-4126-a931-b858950dbf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9a5eba-3bc7-4126-a931-b858950dbf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cb609c-b54e-4962-aa77-7766e578f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:54 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Volume d8565ccb-9a82-4efb-8f73-f108b5cef35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e', 'volume_size': 1} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1896174257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8565ccb-9a82-4efb-8f73-f108b5cef35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:55Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Creating volume d8565ccb-9a82-4efb-8f73-f108b5cef35e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:54 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:15:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:54 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e 1073741824 Sep 01 02:15:54 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e 1073741824" returned: 0 in 0.394s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e Sep 01 02:15:55 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cb609c-b54e-4962-aa77-7766e578f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4876973-fc39-4e1c-9953-23f02a5b6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Volume volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e (d8565ccb-9a82-4efb-8f73-f108b5cef35e): created successfully Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4876973-fc39-4e1c-9953-23f02a5b6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (aa908fc6-7229-4c96-8479-b7ecffed7fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bc20914a-61f2-4e92-a6fa-6d4a35934f97 tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-d8565ccb-9a82-4efb-8f73-f108b5cef35e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "cinder-d8565ccb-9a82-4efb-8f73-f108b5cef35e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-quobyte-d8565ccb-9a82-4efb-8f73-f108b5cef35e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-d8565ccb-9a82-4efb-8f73-f108b5cef35e" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8154b-cb22-42b7-a85c-853ebf893190]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e Sep 01 02:15:56 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e" returned: 0 in 0.358s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e Sep 01 02:15:56 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8565ccb-9a82-4efb-8f73-f108b5cef35e" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-d8565ccb-9a82-4efb-8f73-f108b5cef35e" released by "delete_volume" :: held 0.632s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Created reservations ['b78ae958-d1ce-4577-b0e9-b2410f7f3157', 'ff09007e-1db5-4a73-8ae5-cd19e9b17f37', '4df63cae-8cb8-4e1e-a8ce-b6aa7c73ad67', 'aecf235e-89fc-4a55-80d1-9410cfd62512'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:15:56 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Deleted volume successfully. Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-747adb0b-a1a4-4b95-a914-e081c8122eac tempest-VolumesActionsTest-473730501 None] Lock "cinder-d8565ccb-9a82-4efb-8f73-f108b5cef35e-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (036551f9-6a49-40f9-833a-1cc0ab8f07e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1545553e-f8c2-4f2a-b1ab-79fd224c0f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1545553e-f8c2-4f2a-b1ab-79fd224c0f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-362037734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ecd044-5299-4fd5-ac63-167a0aa642b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:58Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d1a7ba-ba06-4a0e-9ea7-39f0cb59b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d1a7ba-ba06-4a0e-9ea7-39f0cb59b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861add3-3e75-4f3f-ac38-4018bc060ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861add3-3e75-4f3f-ac38-4018bc060ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ecd044-5299-4fd5-ac63-167a0aa642b7', 'volume_name': 'volume-32ecd044-5299-4fd5-ac63-167a0aa642b7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92892219-532d-4a7b-8101-1c11a8e5a0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92892219-532d-4a7b-8101-1c11a8e5a0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aab1820-b254-4dd9-bf08-f17aa3cd9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:57 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Volume 32ecd044-5299-4fd5-ac63-167a0aa642b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ecd044-5299-4fd5-ac63-167a0aa642b7', 'volume_size': 1} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-362037734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ecd044-5299-4fd5-ac63-167a0aa642b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:58Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Creating volume 32ecd044-5299-4fd5-ac63-167a0aa642b7 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:57 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:15:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 1073741824 Sep 01 02:15:57 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 1073741824" returned: 0 in 0.409s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:58 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 Sep 01 02:15:58 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aab1820-b254-4dd9-bf08-f17aa3cd9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ecd044-5299-4fd5-ac63-167a0aa642b7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5428f73f-1a7f-4035-bb16-241380afc9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Volume volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 (32ecd044-5299-4fd5-ac63-167a0aa642b7): created successfully Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5428f73f-1a7f-4035-bb16-241380afc9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (036551f9-6a49-40f9-833a-1cc0ab8f07e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:58 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-cf601829-60f1-4031-9562-a4a45136d496 tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-32ecd044-5299-4fd5-ac63-167a0aa642b7-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "cinder-32ecd044-5299-4fd5-ac63-167a0aa642b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-quobyte-32ecd044-5299-4fd5-ac63-167a0aa642b7" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-32ecd044-5299-4fd5-ac63-167a0aa642b7" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded9485-db19-4f63-9223-b6c27c45dfb8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 Sep 01 02:15:59 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:59 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7" returned: 0 in 0.341s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7 Sep 01 02:15:59 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:59 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-32ecd044-5299-4fd5-ac63-167a0aa642b7" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-32ecd044-5299-4fd5-ac63-167a0aa642b7" released by "delete_volume" :: held 0.627s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Created reservations ['6082e22f-5ca9-4e4d-aa1c-a6ec76feef6e', '4f1e7030-9c1a-4c3c-89e7-18dd80a091cb', 'bb1c48f6-3bc6-4341-aad5-0e4cbcde0681', '8d772df5-f1b5-421b-aac1-01d580ac77fd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:15:59 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:00 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:00 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Deleted volume successfully. Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-63c3d361-92c9-4c08-89a1-62576fd3b860 tempest-VolumesActionsTest-473730501 None] Lock "cinder-32ecd044-5299-4fd5-ac63-167a0aa642b7-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (3ba0a62a-2c7f-4859-bf0b-d2f86bf7422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db28a89d-126a-4675-8ac8-c0fdfbb96687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db28a89d-126a-4675-8ac8-c0fdfbb96687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163284836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51351ee-6f5c-4c5a-92e7-f18da03148e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:01Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bda3cf-73b9-4c08-a64a-22ea2f189138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bda3cf-73b9-4c08-a64a-22ea2f189138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf46a56f-dbe6-4731-8b0d-a5bb92e60b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf46a56f-dbe6-4731-8b0d-a5bb92e60b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51351ee-6f5c-4c5a-92e7-f18da03148e8', 'volume_name': 'volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16cb1df-2f6a-4c79-a786-2c83fef3a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16cb1df-2f6a-4c79-a786-2c83fef3a09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a53d98-47c0-4af1-bad4-883fde24f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:00 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Volume c51351ee-6f5c-4c5a-92e7-f18da03148e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8', 'volume_size': 1} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163284836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51351ee-6f5c-4c5a-92e7-f18da03148e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:01Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Creating volume c51351ee-6f5c-4c5a-92e7-f18da03148e8 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:00 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:00 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 1073741824 Sep 01 02:16:00 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:01 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 1073741824" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:01 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 Sep 01 02:16:01 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:01 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a53d98-47c0-4af1-bad4-883fde24f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a1d704-4c04-4a64-8c06-930460bc78c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:01 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Volume volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 (c51351ee-6f5c-4c5a-92e7-f18da03148e8): created successfully Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a1d704-4c04-4a64-8c06-930460bc78c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (3ba0a62a-2c7f-4859-bf0b-d2f86bf7422a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:01 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0a85c97c-3132-496f-bae1-6ff994f6a669 tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-c51351ee-6f5c-4c5a-92e7-f18da03148e8-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "cinder-c51351ee-6f5c-4c5a-92e7-f18da03148e8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-quobyte-c51351ee-6f5c-4c5a-92e7-f18da03148e8" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-c51351ee-6f5c-4c5a-92e7-f18da03148e8" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0046f30e-f15b-4664-9181-54c2fd270a3f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:02 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 Sep 01 02:16:02 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:02 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:02 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8 Sep 01 02:16:02 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:02 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c51351ee-6f5c-4c5a-92e7-f18da03148e8" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-c51351ee-6f5c-4c5a-92e7-f18da03148e8" released by "delete_volume" :: held 0.605s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Created reservations ['16db545e-b172-4a39-81f2-71305151a882', 'ec137994-998c-4e8b-8a51-f837b1cc12d7', '6e07350e-e75b-45cf-8395-d891f2eda6c5', '5af77383-95a8-44ce-b313-881e0b455624'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:02 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:02 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:02 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Deleted volume successfully. Sep 01 02:16:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-78190eac-0f40-4991-bdad-96bf6dde90b6 tempest-VolumesActionsTest-473730501 None] Lock "cinder-c51351ee-6f5c-4c5a-92e7-f18da03148e8-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (8131827c-e9c3-478e-b34f-f178774ca454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3641a3e-5695-4c1c-bed2-607d5ac2518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3641a3e-5695-4c1c-bed2-607d5ac2518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-397734970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4a150a-5d48-4784-a07f-03074b1164e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:03Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04af0cef-0066-43dd-98b5-b0bb74b68453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04af0cef-0066-43dd-98b5-b0bb74b68453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f209f1e1-6c46-4c3f-937d-f78d92d93349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f209f1e1-6c46-4c3f-937d-f78d92d93349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4a150a-5d48-4784-a07f-03074b1164e4', 'volume_name': 'volume-af4a150a-5d48-4784-a07f-03074b1164e4', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dfbb9c-7b5f-4ffc-8a52-9c9293bab7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dfbb9c-7b5f-4ffc-8a52-9c9293bab7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14595848-5bf8-4038-a3e1-b2825bad4db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Volume af4a150a-5d48-4784-a07f-03074b1164e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4a150a-5d48-4784-a07f-03074b1164e4', 'volume_size': 1} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-397734970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4a150a-5d48-4784-a07f-03074b1164e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:03Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Creating volume af4a150a-5d48-4784-a07f-03074b1164e4 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:03 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:03 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 1073741824 Sep 01 02:16:03 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:03 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 1073741824" returned: 0 in 0.397s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:03 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 Sep 01 02:16:03 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:04 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14595848-5bf8-4038-a3e1-b2825bad4db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4a150a-5d48-4784-a07f-03074b1164e4', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63518489-897e-407d-b4e5-20c22adf4d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Volume volume-af4a150a-5d48-4784-a07f-03074b1164e4 (af4a150a-5d48-4784-a07f-03074b1164e4): created successfully Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63518489-897e-407d-b4e5-20c22adf4d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (8131827c-e9c3-478e-b34f-f178774ca454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-18253f92-b925-4ae0-854c-9a58fd48ec6e tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-af4a150a-5d48-4784-a07f-03074b1164e4-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "cinder-af4a150a-5d48-4784-a07f-03074b1164e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Acquiring lock "cinder-quobyte-af4a150a-5d48-4784-a07f-03074b1164e4" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-af4a150a-5d48-4784-a07f-03074b1164e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a88e7a-7b85-479f-a90d-9c4b0ff4080c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:04 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 Sep 01 02:16:04 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:05 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4" returned: 0 in 0.359s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:05 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4 Sep 01 02:16:05 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:05 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-af4a150a-5d48-4784-a07f-03074b1164e4" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "cinder-quobyte-af4a150a-5d48-4784-a07f-03074b1164e4" released by "delete_volume" :: held 0.625s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Created reservations ['a9f5f154-a726-4e69-ad41-009641f2755f', 'c7ba89c9-de73-435c-a4c1-56ccd80a9c97', 'f2858ed8-84d6-4161-b9bd-d506a596d8ea', 'bd75f8dc-4eec-4980-b012-d3f36e171060'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:05 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:05 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:05 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Deleted volume successfully. Sep 01 02:16:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-20a59a3e-5920-4d4e-aec4-0fd2d4e00260 tempest-VolumesActionsTest-473730501 None] Lock "cinder-af4a150a-5d48-4784-a07f-03074b1164e4-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (2ba5e38c-f640-4b31-a92f-e96a48021c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca00c1c-cfe9-4cbc-babd-5cb42cc6c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca00c1c-cfe9-4cbc-babd-5cb42cc6c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-722982881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7207c0b9-ce5b-43ea-9519-5763c64bcc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:06Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8f4ab0-11bd-4803-9947-8421b3e2171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8f4ab0-11bd-4803-9947-8421b3e2171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8422067-e85b-4a27-9885-e2d666ab7dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8422067-e85b-4a27-9885-e2d666ab7dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7207c0b9-ce5b-43ea-9519-5763c64bcc59', 'volume_name': 'volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74add73b-a63f-4a5e-8158-0e61d178918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74add73b-a63f-4a5e-8158-0e61d178918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e90b650-b2cf-4588-baab-44a8f92375bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Volume 7207c0b9-ce5b-43ea-9519-5763c64bcc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59', 'volume_size': 1} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-722982881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7207c0b9-ce5b-43ea-9519-5763c64bcc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22327dafa4634e8e916b16e3b5f3952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:06Z,use_quota=True,user_id='5920ed5e275a4713a13e4989267782b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Creating volume 7207c0b9-ce5b-43ea-9519-5763c64bcc59 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:06 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 1073741824 Sep 01 02:16:06 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 1073741824" returned: 0 in 0.408s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 Sep 01 02:16:06 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e90b650-b2cf-4588-baab-44a8f92375bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e19309-0943-4ce8-968c-748d2eb1bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Volume volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 (7207c0b9-ce5b-43ea-9519-5763c64bcc59): created successfully Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e19309-0943-4ce8-968c-748d2eb1bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Flow 'volume_create_manager' (2ba5e38c-f640-4b31-a92f-e96a48021c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-52f355ea-f91c-492a-abc0-65282029195e tempest-VolumesActionsTest-1906727135 None] Created volume successfully. Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-7207c0b9-ce5b-43ea-9519-5763c64bcc59-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "cinder-7207c0b9-ce5b-43ea-9519-5763c64bcc59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Acquiring lock "cinder-quobyte-7207c0b9-ce5b-43ea-9519-5763c64bcc59" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "cinder-quobyte-7207c0b9-ce5b-43ea-9519-5763c64bcc59" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b902c-1fb8-419f-a98d-c5830f3d2284]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 Sep 01 02:16:08 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59" returned: 0 in 0.364s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59 Sep 01 02:16:08 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7207c0b9-ce5b-43ea-9519-5763c64bcc59" returned: 0 in 0.281s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "cinder-quobyte-7207c0b9-ce5b-43ea-9519-5763c64bcc59" released by "delete_volume" :: held 0.683s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Created reservations ['4c57d56b-3b46-4e8d-b39f-9f7d89f8b7fe', '09adb870-bf5d-403b-8506-f34c35021b82', '6dfe0ff3-089f-408f-9243-40719f1556b1', '1421136c-dc10-4e79-a4b7-4aba38296b5e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:08 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Deleted volume successfully. Sep 01 02:16:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bdbe11b4-631e-4e9e-bfd5-0396ab582f9c tempest-VolumesActionsTest-1906727135 None] Lock "cinder-7207c0b9-ce5b-43ea-9519-5763c64bcc59-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:18 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=73,cinder:SELECT=50,cinder:DELETE=5,cinder:INSERT=15 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:18 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=49,cinder:INSERT=17,cinder:UPDATE=66,cinder:DELETE=7 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (2e5e9f72-05a0-4077-bbad-9a59118224a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1ba1f-b5e4-4c61-b300-3ea69de95ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1ba1f-b5e4-4c61-b300-3ea69de95ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-689324777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ca2569-de8f-4491-acc3-e0a132ebc06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8deeab141c2b40f7b381cef7f0acecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='702c0d73f68e442dadeba19477af5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4013046b-8525-446a-89b5-6ddc09512359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4013046b-8525-446a-89b5-6ddc09512359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38a4fd-4389-4e52-b976-2f005a4313fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38a4fd-4389-4e52-b976-2f005a4313fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ca2569-de8f-4491-acc3-e0a132ebc06c', 'volume_name': 'volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21519313-eee1-4f29-b76c-3c266106fba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21519313-eee1-4f29-b76c-3c266106fba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffee5644-4d12-4178-ba2d-bde6eb989d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Volume c4ca2569-de8f-4491-acc3-e0a132ebc06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c', 'volume_size': 1} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-689324777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ca2569-de8f-4491-acc3-e0a132ebc06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8deeab141c2b40f7b381cef7f0acecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='702c0d73f68e442dadeba19477af5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Creating volume c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:20 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:20 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c 1073741824 Sep 01 02:16:20 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c 1073741824" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c Sep 01 02:16:21 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffee5644-4d12-4178-ba2d-bde6eb989d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba68a385-9243-4f91-a1ba-384d28017c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Volume volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c (c4ca2569-de8f-4491-acc3-e0a132ebc06c): created successfully Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba68a385-9243-4f91-a1ba-384d28017c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (2e5e9f72-05a0-4077-bbad-9a59118224a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ef9bcba5-6c82-4737-a256-ee2efffd2f24 tempest-VolumesDeleteCascade-184024708 None] Created volume successfully. Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Creating offline snapshot dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 of volume c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f598a-6d8a-499c-b82d-6f18524885f5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c Sep 01 02:16:22 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 1G Sep 01 02:16:22 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 1G" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:22 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.291s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 is being set with open permissions: ugo+rw Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:23 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info Sep 01 02:16:23 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info is being set with open permissions: ugo+rw Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info Sep 01 02:16:23 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.info" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e3103377-4b85-4b26-974d-b1c20ec1fdd7 tempest-VolumesDeleteCascade-184024708 None] Create snapshot completed successfully Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Creating offline snapshot bc5c7dd7-977f-46c2-bed6-652eac31b23f of volume c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399dac7-6596-4c93-8724-68944f0dd0d9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:24 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:24 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:24 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.396s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:24 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f 1G Sep 01 02:16:24 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f 1G" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f Sep 01 02:16:25 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f" returned: 0 in 0.290s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f is being set with open permissions: ugo+rw Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f Sep 01 02:16:25 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.475s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8290dd0b-18fc-409c-9f23-3f49d1122d3e tempest-VolumesDeleteCascade-184024708 None] Create snapshot completed successfully Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-c4ca2569-de8f-4491-acc3-e0a132ebc06c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-c4ca2569-de8f-4491-acc3-e0a132ebc06c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Performing cascade delete. {{(pid=86925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-bc5c7dd7-977f-46c2-bed6-652eac31b23f-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-bc5c7dd7-977f-46c2-bed6-652eac31b23f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-bc5c7dd7-977f-46c2-bed6-652eac31b23f" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-bc5c7dd7-977f-46c2-bed6-652eac31b23f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Deleting offline snapshot bc5c7dd7-977f-46c2-bed6-652eac31b23f of volume c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] snapshot_file for this snap is: volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[204bdf21-8c32-4b5e-9b14-c35712b14efe]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:26 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f Sep 01 02:16:26 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:26 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed77673e-5bbd-4373-81f1-5ec56b14fe1b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:26 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:26 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:27 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.354s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:27 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f Sep 01 02:16:27 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:27 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:27 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f Sep 01 02:16:27 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:27 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.bc5c7dd7-977f-46c2-bed6-652eac31b23f" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-bc5c7dd7-977f-46c2-bed6-652eac31b23f" released by "_delete_snapshot" :: held 1.401s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" released by "delete_snapshot" :: held 1.421s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Created reservations ['6bb5d05a-505a-405c-b8aa-7029eecb83e4', 'b1bae597-ba85-4b48-b2d7-a7616eedcf1b', '83b5179a-7569-4c7d-93ef-9b8e9d8cfa46', '74d68786-8478-4934-90af-c9f2770e429f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Delete snapshot completed successfully. Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-bc5c7dd7-977f-46c2-bed6-652eac31b23f-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Deleting offline snapshot dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 of volume c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] snapshot_file for this snap is: volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6715d-cd67-4b2a-94ca-ce3441a2387f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:28 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:28 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:28 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe18367-36fc-4994-ae22-ffd16a401c37]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:28 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c Sep 01 02:16:28 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:28 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c" returned: 0 in 0.373s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:28 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:28 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:29 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.352s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:29 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7 Sep 01 02:16:29 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:29 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c.dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7" released by "_delete_snapshot" :: held 1.454s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" released by "delete_snapshot" :: held 1.476s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Created reservations ['4802599a-069b-4a18-9921-31816175a6db', 'cd2b9ee7-303a-4a33-9b60-8f34266b5c04', '194a96d7-e1ee-4ae5-be7d-11ebdf4b640f', '962c626c-fe88-47c4-9497-7d4c6caee1cc'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Delete snapshot completed successfully. Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-dedb27e8-c2e3-4a19-be3b-1cda3f72c1a7-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Snapshots deleted, issuing volume delete {{(pid=86925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" acquired by "delete_volume" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[75156c16-cbf6-4909-ac72-b38324a88ad6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:29 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c Sep 01 02:16:29 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:30 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c" returned: 0 in 0.372s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:30 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c Sep 01 02:16:30 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:30 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c4ca2569-de8f-4491-acc3-e0a132ebc06c" returned: 0 in 0.228s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-c4ca2569-de8f-4491-acc3-e0a132ebc06c" released by "delete_volume" :: held 0.675s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Created reservations ['387c2313-c36e-4d15-b826-df166ab93053', '324edd24-b303-4088-b06e-79bd89e01aa0', 'e699f49f-3863-4229-9565-f806061ae8f8', 'b5d47532-1d73-4fb9-8606-712bf3e1cfb9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:30 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:30 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:30 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Deleted volume successfully. Sep 01 02:16:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8b307c35-34dc-4c27-960c-23883341d273 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-c4ca2569-de8f-4491-acc3-e0a132ebc06c-delete_volume" released by "delete_volume" :: held 4.354s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (051c225d-26e4-42ff-9e66-ea8e7a6c7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b331b93c-f0e5-401a-87d2-30342b509f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b331b93c-f0e5-401a-87d2-30342b509f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1626690076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ecf006-9700-483b-a9d8-da33b31ad6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8deeab141c2b40f7b381cef7f0acecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:31Z,use_quota=True,user_id='702c0d73f68e442dadeba19477af5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a89704-923d-426c-9ba6-280a99009f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a89704-923d-426c-9ba6-280a99009f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052b565b-6609-4b75-9ad7-7d8abfa00992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052b565b-6609-4b75-9ad7-7d8abfa00992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ecf006-9700-483b-a9d8-da33b31ad6c7', 'volume_name': 'volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50cc0f9-2efd-48ea-8c34-945e9715687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50cc0f9-2efd-48ea-8c34-945e9715687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf82133-336e-4ccc-9393-2decb371dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:31 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Volume a8ecf006-9700-483b-a9d8-da33b31ad6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7', 'volume_size': 1} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1626690076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ecf006-9700-483b-a9d8-da33b31ad6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8deeab141c2b40f7b381cef7f0acecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:31Z,use_quota=True,user_id='702c0d73f68e442dadeba19477af5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Creating volume a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:31 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:31 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 1073741824 Sep 01 02:16:31 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:31 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 1073741824" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:31 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:31 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:32 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf82133-336e-4ccc-9393-2decb371dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6e0405-f2a9-4906-917b-2e5fd183ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:32 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Volume volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 (a8ecf006-9700-483b-a9d8-da33b31ad6c7): created successfully Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6e0405-f2a9-4906-917b-2e5fd183ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (051c225d-26e4-42ff-9e66-ea8e7a6c7893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ccf8596f-7a0a-48dd-9b9b-c0d78eee3b02 tempest-VolumesDeleteCascade-184024708 None] Created volume successfully. Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Creating offline snapshot f442bf91-0380-427c-a317-5d8168b32794 of volume a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b48ef-8c82-4af5-b07c-e0712001a045]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:32 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:32 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:32 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:32 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 1G Sep 01 02:16:32 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 1G" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:33 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.284s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 is being set with open permissions: ugo+rw Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:33 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.225s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info Sep 01 02:16:33 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:34 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info" returned: 0 in 0.288s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:34 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info is being set with open permissions: ugo+rw Sep 01 02:16:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:34 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info Sep 01 02:16:34 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:34 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.info" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-64c1c7eb-18d4-4a2b-b4ac-6ff5251ee4d9 tempest-VolumesDeleteCascade-184024708 None] Create snapshot completed successfully Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (63132774-4623-4e1a-9c02-6a8ef811e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f454ea-482e-4c79-9706-6005bffeb6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f454ea-482e-4c79-9706-6005bffeb6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1747379614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1705c58d-16fd-4d4a-9b01-48684dba4b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8deeab141c2b40f7b381cef7f0acecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f442bf91-0380-427c-a317-5d8168b32794,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:35Z,use_quota=True,user_id='702c0d73f68e442dadeba19477af5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5eebcc4-72e1-43e4-b205-5eb19ca87540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5eebcc4-72e1-43e4-b205-5eb19ca87540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea34cb7a-52b3-4404-a2a4-4ab4e65a4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea34cb7a-52b3-4404-a2a4-4ab4e65a4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1705c58d-16fd-4d4a-9b01-48684dba4b34', 'volume_name': 'volume-1705c58d-16fd-4d4a-9b01-48684dba4b34', 'volume_size': 1, 'snapshot_id': 'f442bf91-0380-427c-a317-5d8168b32794'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebfed9b-b126-411b-84c3-fc75f7724634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebfed9b-b126-411b-84c3-fc75f7724634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd3a2d-d31f-4d25-b59c-96e5bfa02d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:35 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Volume 1705c58d-16fd-4d4a-9b01-48684dba4b34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1705c58d-16fd-4d4a-9b01-48684dba4b34', 'volume_size': 1, 'snapshot_id': 'f442bf91-0380-427c-a317-5d8168b32794'} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794-1705c58d-16fd-4d4a-9b01-48684dba4b34" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794-1705c58d-16fd-4d4a-9b01-48684dba4b34" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Creating volume 1705c58d-16fd-4d4a-9b01-48684dba4b34 from snapshot f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] snapshot: f442bf91-0380-427c-a317-5d8168b32794, volume: 1705c58d-16fd-4d4a-9b01-48684dba4b34, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a38f4b-2947-4fae-84ea-2ecf37bc1b9b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:35 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:35 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:35 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.352s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d4321-e43c-439e-8d07-bec42778dc51]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:35 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:35 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:36 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:16:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:16:36 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:16:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:36 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 Sep 01 02:16:36 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:39 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34" returned: 0 in 3.716s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:39 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7, size 1024.00 MB, duration 3.72 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:39 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Converted 1024.00 MB image at 275.48 MB/s Sep 01 02:16:39 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 is being set with open permissions: ugo+rw Sep 01 02:16:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:39 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 Sep 01 02:16:39 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:40 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" released by "_copy_volume_from_snapshot" :: held 4.730s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794-1705c58d-16fd-4d4a-9b01-48684dba4b34" released by "_create_volume_from_snapshot" :: held 4.784s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.799s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd3a2d-d31f-4d25-b59c-96e5bfa02d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1705c58d-16fd-4d4a-9b01-48684dba4b34', 'volume_size': 1, 'snapshot_id': 'f442bf91-0380-427c-a317-5d8168b32794'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3c192a-bfe0-43a7-a39a-b8c22e7338cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Volume volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 (1705c58d-16fd-4d4a-9b01-48684dba4b34): created successfully Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3c192a-bfe0-43a7-a39a-b8c22e7338cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Flow 'volume_create_manager' (63132774-4623-4e1a-9c02-6a8ef811e579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2060aec0-3411-473c-80ce-cc146d7baaa3 tempest-VolumesDeleteCascade-184024708 None] Created volume successfully. Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-a8ecf006-9700-483b-a9d8-da33b31ad6c7-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-a8ecf006-9700-483b-a9d8-da33b31ad6c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Performing cascade delete. {{(pid=86925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-f442bf91-0380-427c-a317-5d8168b32794-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-f442bf91-0380-427c-a317-5d8168b32794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Deleting offline snapshot f442bf91-0380-427c-a317-5d8168b32794 of volume a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] snapshot_file for this snap is: volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c585f44-d40e-4b6b-bec2-246c17ec3f3e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:40 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:40 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:40 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:41 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:16:41 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.355s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d576c7-03f3-42d8-ba72-ce58eb5bbd8f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:41 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:41 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:41 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.511s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:41 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:41 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:42 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.331s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:42 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794 Sep 01 02:16:42 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:42 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7.f442bf91-0380-427c-a317-5d8168b32794" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-f442bf91-0380-427c-a317-5d8168b32794" released by "_delete_snapshot" :: held 1.526s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" released by "delete_snapshot" :: held 1.545s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Created reservations ['9b8f7504-cab7-49a6-8e69-89a0af823da6', '3ce038d4-8ab7-4483-aa57-2e29b5095c05', 'b86079cd-de0d-4420-b3d5-5ef45fa8dc52', 'ebd58fb2-13b3-420b-933a-430af94fc8f4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Delete snapshot completed successfully. Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-f442bf91-0380-427c-a317-5d8168b32794-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Snapshots deleted, issuing volume delete {{(pid=86925) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" acquired by "delete_volume" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b765a5-228e-4c0c-b4e0-dcac5b048cb0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:42 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:42 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:42 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.355s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:42 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7 Sep 01 02:16:42 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:43 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a8ecf006-9700-483b-a9d8-da33b31ad6c7" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-a8ecf006-9700-483b-a9d8-da33b31ad6c7" released by "delete_volume" :: held 0.640s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Created reservations ['b9db8b20-ae37-4067-8720-7b8fe2b1d315', 'ae8c0dbf-5b1a-476f-839a-576d253242c2', 'a7d5f5e6-f973-44ef-8d9c-57daf97e234a', 'c7e2dcbf-e7e2-446e-a2f4-942123f014e7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:43 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:43 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:43 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Deleted volume successfully. Sep 01 02:16:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6add17ed-77fe-4376-87a4-3c4a15500e31 tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-a8ecf006-9700-483b-a9d8-da33b31ad6c7-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-1705c58d-16fd-4d4a-9b01-48684dba4b34-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-1705c58d-16fd-4d4a-9b01-48684dba4b34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf93da5-6e15-44e8-8911-81d70a169375]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 Sep 01 02:16:44 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:44 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34 Sep 01 02:16:44 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:44 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1705c58d-16fd-4d4a-9b01-48684dba4b34" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-quobyte-1705c58d-16fd-4d4a-9b01-48684dba4b34" released by "delete_volume" :: held 0.609s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Created reservations ['0d02ce58-c7af-42d3-93f0-81296aac67ef', '29be3d4e-47d0-4cd9-b43b-2fcd8bedf6b4', 'b5d15dc2-3136-4a31-b49f-38de4937a417', 'e924a411-49ae-4a54-ae7e-8406f291a4f9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:44 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Deleted volume successfully. Sep 01 02:16:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d195c254-5bdd-4552-a26a-53acd2ef32fe tempest-VolumesDeleteCascade-184024708 None] Lock "cinder-1705c58d-16fd-4d4a-9b01-48684dba4b34-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Flow 'volume_create_manager' (faea8b6b-69d6-42c7-895f-aaeb3edd7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2beaec08-ab81-4589-aee4-bcfdc79c51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2beaec08-ab81-4589-aee4-bcfdc79c51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1055369678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f5f43-b683-43b1-a505-cc089da14cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2aa5b2f5b04372ab17365397f46d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:49Z,use_quota=True,user_id='c39215efce354e2a84890947298b6013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e300e076-5344-4869-880d-33ee0d34a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e300e076-5344-4869-880d-33ee0d34a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35802740-e184-4acb-80c9-10153cd8d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35802740-e184-4acb-80c9-10153cd8d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53f5f43-b683-43b1-a505-cc089da14cea', 'volume_name': 'volume-e53f5f43-b683-43b1-a505-cc089da14cea', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cd0f97-c032-4e33-9b88-48a32c8e489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cd0f97-c032-4e33-9b88-48a32c8e489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958f450-8d42-4470-acac-9d70dc301c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:49 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Volume e53f5f43-b683-43b1-a505-cc089da14cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53f5f43-b683-43b1-a505-cc089da14cea', 'volume_size': 1} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1055369678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f5f43-b683-43b1-a505-cc089da14cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2aa5b2f5b04372ab17365397f46d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:49Z,use_quota=True,user_id='c39215efce354e2a84890947298b6013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Creating volume e53f5f43-b683-43b1-a505-cc089da14cea {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:49 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:49 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea 1073741824 Sep 01 02:16:49 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:49 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea 1073741824" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:50 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea Sep 01 02:16:50 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:50 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958f450-8d42-4470-acac-9d70dc301c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53f5f43-b683-43b1-a505-cc089da14cea', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c7c3db-1d61-4e6d-98b6-a7c436f0f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Volume volume-e53f5f43-b683-43b1-a505-cc089da14cea (e53f5f43-b683-43b1-a505-cc089da14cea): created successfully Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c7c3db-1d61-4e6d-98b6-a7c436f0f68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Flow 'volume_create_manager' (faea8b6b-69d6-42c7-895f-aaeb3edd7ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ecd96777-5268-40a5-aa35-d8f6e54c0333 tempest-VolumesTransfersV357Test-683019323 None] Created volume successfully. Sep 01 02:16:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b5d9d332-f04d-4b24-86cf-39115e675897 tempest-VolumesTransfersV357Test-1750598408 None] Transfer volume completed successfully. Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "cinder-e53f5f43-b683-43b1-a505-cc089da14cea-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-e53f5f43-b683-43b1-a505-cc089da14cea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "cinder-quobyte-e53f5f43-b683-43b1-a505-cc089da14cea" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-quobyte-e53f5f43-b683-43b1-a505-cc089da14cea" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f9c32-b45c-4a56-b714-0dc796460208]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea Sep 01 02:16:51 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea Sep 01 02:16:51 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e53f5f43-b683-43b1-a505-cc089da14cea" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-quobyte-e53f5f43-b683-43b1-a505-cc089da14cea" released by "delete_volume" :: held 0.617s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Created reservations ['7ad665d8-295b-430f-bf71-2f6cb1b5154b', 'ca5fc23f-2b30-414a-baa3-ac5c0416e8f7', 'd01e6edb-4ad6-49d5-975d-e100bfd3b5d0', '4506fed5-737c-44aa-87bd-3e84c5042cea'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:52 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:52 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Deleted volume successfully. Sep 01 02:16:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef7a29e-c34b-4064-94d6-f18307775581 tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-e53f5f43-b683-43b1-a505-cc089da14cea-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Flow 'volume_create_manager' (0287cdf8-99d1-4580-997f-f11d4cc38bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fab33b-47b4-4bbb-8f31-c2b34bf39909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fab33b-47b4-4bbb-8f31-c2b34bf39909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-29066747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1524fb-c14a-4acd-b93b-115e3f651167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2aa5b2f5b04372ab17365397f46d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:53Z,use_quota=True,user_id='c39215efce354e2a84890947298b6013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b199ac54-1359-4284-b41d-c63ec0a06012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b199ac54-1359-4284-b41d-c63ec0a06012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e44ae7-a979-4075-b797-98249e9572a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e44ae7-a979-4075-b797-98249e9572a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1524fb-c14a-4acd-b93b-115e3f651167', 'volume_name': 'volume-ed1524fb-c14a-4acd-b93b-115e3f651167', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922c5751-caea-4aa4-b075-daf28a9594ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922c5751-caea-4aa4-b075-daf28a9594ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7f914c-a29a-4a75-8dda-3b7d62402e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Volume ed1524fb-c14a-4acd-b93b-115e3f651167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1524fb-c14a-4acd-b93b-115e3f651167', 'volume_size': 1} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-29066747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1524fb-c14a-4acd-b93b-115e3f651167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2aa5b2f5b04372ab17365397f46d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:53Z,use_quota=True,user_id='c39215efce354e2a84890947298b6013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Creating volume ed1524fb-c14a-4acd-b93b-115e3f651167 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:53 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:53 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 1073741824 Sep 01 02:16:53 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:53 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 1073741824" returned: 0 in 0.463s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:53 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 Sep 01 02:16:53 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:53 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7f914c-a29a-4a75-8dda-3b7d62402e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1524fb-c14a-4acd-b93b-115e3f651167', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c178ef1c-9094-48dd-9a37-15c5bd308195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Volume volume-ed1524fb-c14a-4acd-b93b-115e3f651167 (ed1524fb-c14a-4acd-b93b-115e3f651167): created successfully Sep 01 02:16:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c178ef1c-9094-48dd-9a37-15c5bd308195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Flow 'volume_create_manager' (0287cdf8-99d1-4580-997f-f11d4cc38bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c9f2a73c-8bf5-4550-b52b-0306d31fb23a tempest-VolumesTransfersV357Test-683019323 None] Created volume successfully. Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "cinder-ed1524fb-c14a-4acd-b93b-115e3f651167-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-ed1524fb-c14a-4acd-b93b-115e3f651167-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "cinder-quobyte-ed1524fb-c14a-4acd-b93b-115e3f651167" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-quobyte-ed1524fb-c14a-4acd-b93b-115e3f651167" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daed514-fae9-42ac-a46d-716b988d553c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:55 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 Sep 01 02:16:55 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:55 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167" returned: 0 in 0.336s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:55 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167 Sep 01 02:16:55 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:56 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ed1524fb-c14a-4acd-b93b-115e3f651167" returned: 0 in 0.225s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-quobyte-ed1524fb-c14a-4acd-b93b-115e3f651167" released by "delete_volume" :: held 0.604s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Created reservations ['2bb7482c-992a-4977-ab1c-9d1b4098a660', '2bafb9e0-9879-4359-83f1-84248738cd43', 'e7f27ceb-b35a-405d-b0b6-eb55d125c9d7', 'fd8da553-3423-459e-b4e9-8c4bb5a7ab03'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:56 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:16:56 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:56 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Deleted volume successfully. Sep 01 02:16:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-23e1b243-3ace-4414-a017-3e635b33219e tempest-VolumesTransfersV357Test-1083774322 None] Lock "cinder-ed1524fb-c14a-4acd-b93b-115e3f651167-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (81e559fd-a59a-4858-987f-226900cd8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd7fa65-3792-4d94-a2b1-b4bbc9b71877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd7fa65-3792-4d94-a2b1-b4bbc9b71877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2030991268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3683a846-3bae-43a5-a84b-c76e96dbfd95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:02Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb87cd62-a4ac-4009-853f-9c60934d7696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb87cd62-a4ac-4009-853f-9c60934d7696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdda943-debf-4cbc-8256-554e1fda395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdda943-debf-4cbc-8256-554e1fda395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3683a846-3bae-43a5-a84b-c76e96dbfd95', 'volume_name': 'volume-3683a846-3bae-43a5-a84b-c76e96dbfd95', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b75af4-20f1-4a13-b364-b1d4ba559d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b75af4-20f1-4a13-b364-b1d4ba559d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e2d21-d5b0-482a-bdb1-860301ff5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Volume 3683a846-3bae-43a5-a84b-c76e96dbfd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3683a846-3bae-43a5-a84b-c76e96dbfd95', 'volume_size': 1} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2030991268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3683a846-3bae-43a5-a84b-c76e96dbfd95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:02Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Creating volume 3683a846-3bae-43a5-a84b-c76e96dbfd95 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:02 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 1073741824 Sep 01 02:17:02 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 1073741824" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 Sep 01 02:17:02 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e2d21-d5b0-482a-bdb1-860301ff5196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3683a846-3bae-43a5-a84b-c76e96dbfd95', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202fee6d-418b-4166-9c99-021b3397374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:02 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Volume volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 (3683a846-3bae-43a5-a84b-c76e96dbfd95): created successfully Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202fee6d-418b-4166-9c99-021b3397374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (81e559fd-a59a-4858-987f-226900cd8076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dd3bda6e-b3e5-4a21-a39e-2d9376f5847e tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (a8e27c63-8e4f-459e-a837-30e0c09fb55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9995b886-0e74-4c56-ad16-61f60515371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9995b886-0e74-4c56-ad16-61f60515371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567169736',display_name='tempest-VolumesGetTest-Volume-877406546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2303c31b-350d-481c-acab-977b60816c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:04Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d17d24-0e2c-4e20-995f-56a54d7db406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d17d24-0e2c-4e20-995f-56a54d7db406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33621039-6d07-4174-929b-bccdf41b8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33621039-6d07-4174-929b-bccdf41b8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2303c31b-350d-481c-acab-977b60816c65', 'volume_name': 'volume-2303c31b-350d-481c-acab-977b60816c65', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da76cdb-5c2f-46d2-a764-1a8adf7c6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da76cdb-5c2f-46d2-a764-1a8adf7c6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d97c9e-ae00-4c1e-8aed-d37552fff3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Volume 2303c31b-350d-481c-acab-977b60816c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2303c31b-350d-481c-acab-977b60816c65', 'volume_size': 1} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567169736',display_name='tempest-VolumesGetTest-Volume-877406546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2303c31b-350d-481c-acab-977b60816c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:04Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Creating volume 2303c31b-350d-481c-acab-977b60816c65 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:03 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:03 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 1073741824 Sep 01 02:17:03 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:04 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 1073741824" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:04 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 Sep 01 02:17:04 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:04 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d97c9e-ae00-4c1e-8aed-d37552fff3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2303c31b-350d-481c-acab-977b60816c65', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32684944-50be-4523-b757-5faa9c60821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Volume volume-2303c31b-350d-481c-acab-977b60816c65 (2303c31b-350d-481c-acab-977b60816c65): created successfully Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32684944-50be-4523-b757-5faa9c60821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (a8e27c63-8e4f-459e-a837-30e0c09fb55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-56c324f5-64af-48c1-9714-83f93e0f8fa0 tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-2303c31b-350d-481c-acab-977b60816c65-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "cinder-2303c31b-350d-481c-acab-977b60816c65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-2303c31b-350d-481c-acab-977b60816c65" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-2303c31b-350d-481c-acab-977b60816c65" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64dd7b7-9abe-4b64-84bf-1e3aa467d787]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 Sep 01 02:17:05 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:05 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65" returned: 0 in 0.345s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65 Sep 01 02:17:05 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:05 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2303c31b-350d-481c-acab-977b60816c65" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-2303c31b-350d-481c-acab-977b60816c65" released by "delete_volume" :: held 0.633s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Created reservations ['2f1ba5da-59a3-49fc-8d4f-f9a41e54ca8a', 'f08d924d-61ef-4584-8de5-e61f4f3f3f9f', '144cfc12-8557-4839-ba9e-5330546f0d25', '40dbe4de-7276-477d-81ef-88997d5c18c8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:05 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:05 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.225s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c36caca3-9c68-497c-8352-06b9a4a17bcd tempest-VolumesGetTest-1698864068 None] Lock "cinder-2303c31b-350d-481c-acab-977b60816c65-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-3683a846-3bae-43a5-a84b-c76e96dbfd95-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "cinder-3683a846-3bae-43a5-a84b-c76e96dbfd95-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-3683a846-3bae-43a5-a84b-c76e96dbfd95" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3683a846-3bae-43a5-a84b-c76e96dbfd95" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606bcd3-3dbb-47d3-bb52-136f62f1a72c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 Sep 01 02:17:06 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95 Sep 01 02:17:06 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3683a846-3bae-43a5-a84b-c76e96dbfd95" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3683a846-3bae-43a5-a84b-c76e96dbfd95" released by "delete_volume" :: held 0.615s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Created reservations ['e4690a21-61f2-41c2-8372-2080440147ea', '451036ca-7899-4d67-abb5-c658aed71d2c', '208609cd-4863-49e4-9df1-83a6ad16036b', '0cc84db1-699b-4836-a663-cef2a47e1ead'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:06 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:07 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-302df557-06a3-4d47-ad95-d5da23209700 tempest-VolumesGetTest-1698864068 None] Lock "cinder-3683a846-3bae-43a5-a84b-c76e96dbfd95-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (e0b96a66-6306-4881-b854-1c0f226b61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e089b2-57b1-4773-aae4-bfbc0acfbfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e089b2-57b1-4773-aae4-bfbc0acfbfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1860039721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e05d0b2-6f91-4522-b807-4478e70fd986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:08Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b75eb8-a9ea-4995-9bfe-7729d64d9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b75eb8-a9ea-4995-9bfe-7729d64d9784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc35ca5-991c-4429-8f65-275543e4eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc35ca5-991c-4429-8f65-275543e4eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e05d0b2-6f91-4522-b807-4478e70fd986', 'volume_name': 'volume-2e05d0b2-6f91-4522-b807-4478e70fd986', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6667d-1e73-4d40-8de8-7b97b11a6b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6667d-1e73-4d40-8de8-7b97b11a6b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17794d02-d8ad-40ed-9045-bb76487663d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Volume 2e05d0b2-6f91-4522-b807-4478e70fd986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e05d0b2-6f91-4522-b807-4478e70fd986', 'volume_size': 1} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1860039721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e05d0b2-6f91-4522-b807-4478e70fd986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:08Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Creating volume 2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:07 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:07 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 1073741824 Sep 01 02:17:07 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 1073741824" returned: 0 in 0.420s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:08 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17794d02-d8ad-40ed-9045-bb76487663d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e05d0b2-6f91-4522-b807-4478e70fd986', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c6370-1f3c-43b0-8090-50b063464405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Volume volume-2e05d0b2-6f91-4522-b807-4478e70fd986 (2e05d0b2-6f91-4522-b807-4478e70fd986): created successfully Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c6370-1f3c-43b0-8090-50b063464405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (e0b96a66-6306-4881-b854-1c0f226b61f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ba6c5075-441f-41f6-ab07-ac8194cf1bc3 tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (b4f9f457-de9f-40f6-b370-1205f6b0bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96da06c-dc1b-4d82-becd-dab5b8ac5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96da06c-dc1b-4d82-becd-dab5b8ac5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1836999646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2e05d0b2-6f91-4522-b807-4478e70fd986,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:09Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd20ad5-2c23-46dd-950b-807bcbf4c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd20ad5-2c23-46dd-950b-807bcbf4c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e31fdf-7b55-4c9f-9dd6-f43c43bc0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e31fdf-7b55-4c9f-9dd6-f43c43bc0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a', 'volume_name': 'volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a', 'volume_size': 1, 'source_volid': '2e05d0b2-6f91-4522-b807-4478e70fd986', 'source_volstatus': 'available'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddc04a3-9567-4f08-8b9b-fe7f74649ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddc04a3-9567-4f08-8b9b-fe7f74649ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c346d5-fc29-494a-8269-073e1dcffd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Volume 3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a', 'volume_size': 1, 'source_volid': '2e05d0b2-6f91-4522-b807-4478e70fd986', 'source_volstatus': 'available'} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:09 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Cloning volume 2e05d0b2-6f91-4522-b807-4478e70fd986 to volume 3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Creating offline snapshot d8a39c22-3f4b-4f46-8945-bfe5cbc5616d of volume 2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e008f2-40f6-41cf-b66a-40b4032bd8bd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:09 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:09 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:09 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:09 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d 1G Sep 01 02:17:09 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d 1G" returned: 0 in 0.383s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e05d0b2-6f91-4522-b807-4478e70fd986 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e05d0b2-6f91-4522-b807-4478e70fd986 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:10 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e05d0b2-6f91-4522-b807-4478e70fd986 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d is being set with open permissions: ugo+rw Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:10 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info Sep 01 02:17:10 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info is being set with open permissions: ugo+rw Sep 01 02:17:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info Sep 01 02:17:10 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.info" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] snapshot: d8a39c22-3f4b-4f46-8945-bfe5cbc5616d, volume: 3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[243fd3d8-d5da-4c17-8512-419edf9ffaf0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:11 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e05d0b2-6f91-4522-b807-4478e70fd986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b281f04-3c8f-4734-a528-67b6951bc090]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:11 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.345s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:17:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a Sep 01 02:17:11 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:15 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" returned: 0 in 3.800s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:15 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:15 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Converted 1024.00 MB image at 269.39 MB/s Sep 01 02:17:15 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a is being set with open permissions: ugo+rw Sep 01 02:17:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:15 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a Sep 01 02:17:15 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:15 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" released by "_copy_volume_from_snapshot" :: held 4.796s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Deleting offline snapshot d8a39c22-3f4b-4f46-8945-bfe5cbc5616d of volume 2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] snapshot_file for this snap is: volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a52b1-dad1-4eaf-964f-9388ba4402e3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:16 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:16 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e05d0b2-6f91-4522-b807-4478e70fd986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6458d69-e763-4434-96b5-f6e8cb3d8b30]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:16 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:16 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.536s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:17 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.324s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d Sep 01 02:17:17 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986.d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-d8a39c22-3f4b-4f46-8945-bfe5cbc5616d" released by "_delete_snapshot" :: held 1.560s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.249s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c346d5-fc29-494a-8269-073e1dcffd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a', 'volume_size': 1, 'source_volid': '2e05d0b2-6f91-4522-b807-4478e70fd986', 'source_volstatus': 'available'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b9df7-b35b-4495-9c7e-4b03ed121c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Volume volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a (3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a): created successfully Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b9df7-b35b-4495-9c7e-4b03ed121c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (b4f9f457-de9f-40f6-b370-1205f6b0bff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-51c0ce12-8b94-48b6-ac52-38296da2997f tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (eb5e7923-32ad-46ed-90b1-1c69004e8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d724aa0-9ad9-4f4d-8e26-effd279d5864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d724aa0-9ad9-4f4d-8e26-effd279d5864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1957936795',display_name='tempest-VolumesGetTest-Volume-1856657349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa41923-a8b5-4e26-9dd6-e81286434ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:19Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d145d27-8469-4f97-b29a-48eded4cacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d145d27-8469-4f97-b29a-48eded4cacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9060bcc7-1ad7-4e45-9422-daab468cffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9060bcc7-1ad7-4e45-9422-daab468cffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa41923-a8b5-4e26-9dd6-e81286434ba0', 'volume_name': 'volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89526fc0-c282-4624-8645-570416e2ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89526fc0-c282-4624-8645-570416e2ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc48671-47a9-4ac4-acbb-e80c31996f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Volume 7aa41923-a8b5-4e26-9dd6-e81286434ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0', 'volume_size': 1} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1957936795',display_name='tempest-VolumesGetTest-Volume-1856657349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa41923-a8b5-4e26-9dd6-e81286434ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:19Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Creating volume 7aa41923-a8b5-4e26-9dd6-e81286434ba0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:18 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 1073741824 Sep 01 02:17:18 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 1073741824" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=91,cinder:INSERT=24,cinder:UPDATE=103,cinder:DELETE=7 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=110,cinder:SELECT=80,cinder:DELETE=12,cinder:INSERT=29 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 Sep 01 02:17:19 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc48671-47a9-4ac4-acbb-e80c31996f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a33476-ccd4-423a-9352-d72da03945ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Volume volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 (7aa41923-a8b5-4e26-9dd6-e81286434ba0): created successfully Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a33476-ccd4-423a-9352-d72da03945ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (eb5e7923-32ad-46ed-90b1-1c69004e8938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-77dd2fb1-a9c5-4d9e-9ba7-f5b12eff4541 tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-7aa41923-a8b5-4e26-9dd6-e81286434ba0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "cinder-7aa41923-a8b5-4e26-9dd6-e81286434ba0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-7aa41923-a8b5-4e26-9dd6-e81286434ba0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-7aa41923-a8b5-4e26-9dd6-e81286434ba0" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca614a-0c2e-44a2-a4a9-764f2d77f5d6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 Sep 01 02:17:19 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0 Sep 01 02:17:20 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7aa41923-a8b5-4e26-9dd6-e81286434ba0" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-7aa41923-a8b5-4e26-9dd6-e81286434ba0" released by "delete_volume" :: held 0.622s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Created reservations ['c1fd8351-f053-4920-a465-398c6ee5b200', '70cb4980-5a63-417e-a334-60deba43cc1c', 'd4408416-f38b-4c67-8269-98c10e34ade9', '1f90f24b-6b0f-487e-a509-969d0ebdc935'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:20 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7a078a03-87a9-4fe9-bbeb-03d097ab3212 tempest-VolumesGetTest-1698864068 None] Lock "cinder-7aa41923-a8b5-4e26-9dd6-e81286434ba0-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "cinder-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3ef138-255d-4d66-bb28-0d64f80f9d96]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a Sep 01 02:17:21 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a Sep 01 02:17:21 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a" released by "delete_volume" :: held 0.620s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Created reservations ['a4f4403d-ff0e-492f-84fc-85a176fd41ac', '75697afb-4ff7-45df-b9c8-7782c2cb51fb', 'ad43e0c8-697b-4aab-b64b-2446a2f7533e', 'cceb9fee-a7e7-4c5d-a32c-324068660083'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:21 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f2f6242-d2ab-497e-900d-e14277c3f42c tempest-VolumesGetTest-1698864068 None] Lock "cinder-3096c8d2-ded2-42ae-8a4d-2bf61f1ad46a-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-2e05d0b2-6f91-4522-b807-4478e70fd986-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "cinder-2e05d0b2-6f91-4522-b807-4478e70fd986-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-2e05d0b2-6f91-4522-b807-4478e70fd986" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-2e05d0b2-6f91-4522-b807-4478e70fd986" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8c090-5ac1-4985-9a58-3eee99065ab0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:22 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.341s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986 Sep 01 02:17:22 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2e05d0b2-6f91-4522-b807-4478e70fd986" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-2e05d0b2-6f91-4522-b807-4478e70fd986" released by "delete_volume" :: held 0.620s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Created reservations ['c6be4314-4af3-4730-b544-baafb1e4eed6', '9217e541-39c3-407f-9fad-226503b57f21', 'f36e0c61-5e43-4358-9d46-15771ac4186f', 'a5e2fda1-d483-4f10-b274-722e922f18fd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:22 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6292685f-9456-4989-88c7-06019eeb3c86 tempest-VolumesGetTest-1698864068 None] Lock "cinder-2e05d0b2-6f91-4522-b807-4478e70fd986-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (23717430-3d32-47d5-b61a-a228342b9554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c648da2-bd2d-4731-9420-b9679b37cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c648da2-bd2d-4731-9420-b9679b37cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545350298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f52536-72f0-48f7-b389-6950281fd69d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:24Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8939530-a8f1-4eb6-ba99-1c6c96d0271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8939530-a8f1-4eb6-ba99-1c6c96d0271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3349b562-7e25-4954-8831-7a012372f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3349b562-7e25-4954-8831-7a012372f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2f52536-72f0-48f7-b389-6950281fd69d', 'volume_name': 'volume-f2f52536-72f0-48f7-b389-6950281fd69d', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5a9bc4-a868-47ce-84f0-e7a6d40dd6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5a9bc4-a868-47ce-84f0-e7a6d40dd6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313966c2-4330-4e95-ac52-9c8fc1fffec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:24 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Volume f2f52536-72f0-48f7-b389-6950281fd69d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2f52536-72f0-48f7-b389-6950281fd69d', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Trying to clone f2f52536-72f0-48f7-b389-6950281fd69d from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:17:24 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb16fd-b380-4aea-98e0-94556d6af4b3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD Sep 01 02:17:24 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 is fetched for user 283443f5bfd244d0bc289e8eeb3a7367. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb5a30-826d-48de-a1f8-928b180fff65]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD Sep 01 02:17:25 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD" returned: 0 in 0.306s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545350298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f52536-72f0-48f7-b389-6950281fd69d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:24Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Creating volume f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:25 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1073741824 Sep 01 02:17:25 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1073741824" returned: 0 in 0.384s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d Sep 01 02:17:25 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Attempting download of 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume f2f52536-72f0-48f7-b389-6950281fd69d. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d3fba-cf37-418b-871b-df44ed0295cf]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun Sep 01 02:17:26 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun" returned: 0 in 0.302s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun Sep 01 02:17:26 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun" returned: 1 in 0.299s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514cc436-eb47-42bc-a3be-d669f2c6dfb1_86o5vpun' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[206628b4-7dbf-46db-8974-d145b1ccace8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD Sep 01 02:17:26 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] 514cc436-eb47-42bc-a3be-d669f2c6dfb1 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:17:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d Sep 01 02:17:27 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d" returned: 0 in 1.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514cc436-eb47-42bc-a3be-d669f2c6dfb1_kjv_vx06devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:28 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Converted 112.00 MB image at 75.80 MB/s Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1G Sep 01 02:17:28 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d 1G" returned: 0 in 0.286s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Downloaded image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}])) to volume f2f52536-72f0-48f7-b389-6950281fd69d successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Temporary image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 for user 283443f5bfd244d0bc289e8eeb3a7367 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Marking volume f2f52536-72f0-48f7-b389-6950281fd69d as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Copying metadata from image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 to f2f52536-72f0-48f7-b389-6950281fd69d. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Creating volume glance metadata for volume f2f52536-72f0-48f7-b389-6950281fd69d backed by image 514cc436-eb47-42bc-a3be-d669f2c6dfb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313966c2-4330-4e95-ac52-9c8fc1fffec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f52536-72f0-48f7-b389-6950281fd69d', 'volume_size': 1, 'image_id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7da3a053d34c47e08d9b40567612154c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514cc436-eb47-42bc-a3be-d669f2c6dfb1', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514cc436-eb47-42bc-a3be-d669f2c6dfb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de8560a-ccfa-4508-a3b9-fdd25a99ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Volume volume-f2f52536-72f0-48f7-b389-6950281fd69d (f2f52536-72f0-48f7-b389-6950281fd69d): created successfully Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de8560a-ccfa-4508-a3b9-fdd25a99ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (23717430-3d32-47d5-b61a-a228342b9554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a1101fe4-fc31-416e-b68d-d66209e7f16e tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (6285ce02-c91c-4728-b643-7c52e4237ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c168c24-5b79-4b86-b989-163ab80eea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c168c24-5b79-4b86-b989-163ab80eea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1846969937',display_name='tempest-VolumesGetTest-Volume-7822886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25bec3e-2140-4164-8b8d-1bcc23c81132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:30Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f129a728-8bea-43b6-93eb-176d99101eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f129a728-8bea-43b6-93eb-176d99101eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166dfb8-96dd-446b-a094-dff3cddfcedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166dfb8-96dd-446b-a094-dff3cddfcedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25bec3e-2140-4164-8b8d-1bcc23c81132', 'volume_name': 'volume-e25bec3e-2140-4164-8b8d-1bcc23c81132', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5954fa-9248-4e11-b559-46e0d75150bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5954fa-9248-4e11-b559-46e0d75150bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16d6ac1-07a4-4795-98fc-dc79e10df532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Volume e25bec3e-2140-4164-8b8d-1bcc23c81132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25bec3e-2140-4164-8b8d-1bcc23c81132', 'volume_size': 1} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1846969937',display_name='tempest-VolumesGetTest-Volume-7822886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25bec3e-2140-4164-8b8d-1bcc23c81132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadd1415d2164b81bb69d5c31471514e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:30Z,use_quota=True,user_id='283443f5bfd244d0bc289e8eeb3a7367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Creating volume e25bec3e-2140-4164-8b8d-1bcc23c81132 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:29 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 1073741824 Sep 01 02:17:30 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 1073741824" returned: 0 in 0.393s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 Sep 01 02:17:30 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16d6ac1-07a4-4795-98fc-dc79e10df532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25bec3e-2140-4164-8b8d-1bcc23c81132', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bef754-2a59-4f4b-9e2b-3a4a64acf49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Volume volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 (e25bec3e-2140-4164-8b8d-1bcc23c81132): created successfully Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bef754-2a59-4f4b-9e2b-3a4a64acf49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Flow 'volume_create_manager' (6285ce02-c91c-4728-b643-7c52e4237ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9de1bcbe-f870-4c17-8183-8518ad5b0186 tempest-VolumesGetTest-1698864068 None] Created volume successfully. Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-e25bec3e-2140-4164-8b8d-1bcc23c81132-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "cinder-e25bec3e-2140-4164-8b8d-1bcc23c81132-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-e25bec3e-2140-4164-8b8d-1bcc23c81132" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-e25bec3e-2140-4164-8b8d-1bcc23c81132" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d9ab5-d93a-4154-8a3f-58ce507f1e2e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:31 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 Sep 01 02:17:31 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:31 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132" returned: 0 in 0.377s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:31 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132 Sep 01 02:17:31 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:31 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e25bec3e-2140-4164-8b8d-1bcc23c81132" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-e25bec3e-2140-4164-8b8d-1bcc23c81132" released by "delete_volume" :: held 0.661s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Created reservations ['8b507611-ce47-49b5-bfae-f0c7e75389ab', '6d76907d-9791-4d2a-80e1-ba6159706d5a', '7eb7576f-0776-47b9-904e-7401a53d60b6', '91d2d148-2fe5-46a3-b295-86ff509fe269'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:31 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:31 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.282s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fef60f6c-e4e5-4b85-9431-2f8ac79e82c3 tempest-VolumesGetTest-1698864068 None] Lock "cinder-e25bec3e-2140-4164-8b8d-1bcc23c81132-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-f2f52536-72f0-48f7-b389-6950281fd69d-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "cinder-f2f52536-72f0-48f7-b389-6950281fd69d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Acquiring lock "cinder-quobyte-f2f52536-72f0-48f7-b389-6950281fd69d" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-f2f52536-72f0-48f7-b389-6950281fd69d" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[56734fa4-8fed-4965-814c-d42b7e594b25]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d Sep 01 02:17:32 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d" returned: 0 in 0.419s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d Sep 01 02:17:32 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2f52536-72f0-48f7-b389-6950281fd69d" returned: 0 in 0.290s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "cinder-quobyte-f2f52536-72f0-48f7-b389-6950281fd69d" released by "delete_volume" :: held 0.759s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Created reservations ['eb4da76d-bc67-431d-a22e-8fb81c600d6f', '92862a8a-9a90-477b-9936-0c402e922241', '5d04cb56-4f46-47a9-9a53-928a8080b308', '88aba29f-d963-493b-82fc-86376c6b67fb'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:33 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:33 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.285s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Deleted volume successfully. Sep 01 02:17:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c24e7047-7433-4110-9870-9d23a1fc509d tempest-VolumesGetTest-1698864068 None] Lock "cinder-f2f52536-72f0-48f7-b389-6950281fd69d-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (e57f0c9b-5127-462d-9ccd-c4aa99528ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3597ef-4a19-4f73-ac33-088273994519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3597ef-4a19-4f73-ac33-088273994519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-756834800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8748310-e29a-49ff-9de4-c4377bfa6820,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:36Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c372ecb5-a115-4810-a06b-6db2298f942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c372ecb5-a115-4810-a06b-6db2298f942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5728813-f136-4418-b8b1-916402e01fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5728813-f136-4418-b8b1-916402e01fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8748310-e29a-49ff-9de4-c4377bfa6820', 'volume_name': 'volume-c8748310-e29a-49ff-9de4-c4377bfa6820', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4bb93b-6643-428c-9c78-3c68b45ffdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4bb93b-6643-428c-9c78-3c68b45ffdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2282c94c-88ea-4b8d-9c77-3d518275b05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Volume c8748310-e29a-49ff-9de4-c4377bfa6820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8748310-e29a-49ff-9de4-c4377bfa6820', 'volume_size': 1} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-756834800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8748310-e29a-49ff-9de4-c4377bfa6820,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:36Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Creating volume c8748310-e29a-49ff-9de4-c4377bfa6820 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:36 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 1073741824 Sep 01 02:17:36 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:36 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 1073741824" returned: 0 in 0.403s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 Sep 01 02:17:36 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:37 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2282c94c-88ea-4b8d-9c77-3d518275b05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8748310-e29a-49ff-9de4-c4377bfa6820', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7ba1be-526a-4467-93ca-bf318476a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Volume volume-c8748310-e29a-49ff-9de4-c4377bfa6820 (c8748310-e29a-49ff-9de4-c4377bfa6820): created successfully Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7ba1be-526a-4467-93ca-bf318476a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (e57f0c9b-5127-462d-9ccd-c4aa99528ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-13e796bb-489d-475a-b4f3-5712b6ccb29b tempest-VolumesListTestJSON-536786808 None] Created volume successfully. Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (b8e6e060-2666-4fe7-8433-5661ad318ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98532c61-13a2-4277-8129-d7aba1ce4d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98532c61-13a2-4277-8129-d7aba1ce4d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-492790986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037782bd-3907-4861-8557-7c17891ba498,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:38Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19442b97-d266-401a-bcf2-4bdec51e5151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19442b97-d266-401a-bcf2-4bdec51e5151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417bdac3-a428-4d2b-b001-d959441dedfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417bdac3-a428-4d2b-b001-d959441dedfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037782bd-3907-4861-8557-7c17891ba498', 'volume_name': 'volume-037782bd-3907-4861-8557-7c17891ba498', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e16bd-90c5-4431-ac6e-b12e4dd0164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e16bd-90c5-4431-ac6e-b12e4dd0164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb2d793-c46b-47f6-97b0-216bbdbee0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Volume 037782bd-3907-4861-8557-7c17891ba498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037782bd-3907-4861-8557-7c17891ba498', 'volume_size': 1} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-492790986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037782bd-3907-4861-8557-7c17891ba498,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:38Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Creating volume 037782bd-3907-4861-8557-7c17891ba498 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:37 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:37 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 1073741824 Sep 01 02:17:37 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 1073741824" returned: 0 in 0.398s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 Sep 01 02:17:38 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb2d793-c46b-47f6-97b0-216bbdbee0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037782bd-3907-4861-8557-7c17891ba498', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf25a9f-4aa8-499c-8e29-4176d322e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Volume volume-037782bd-3907-4861-8557-7c17891ba498 (037782bd-3907-4861-8557-7c17891ba498): created successfully Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf25a9f-4aa8-499c-8e29-4176d322e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (b8e6e060-2666-4fe7-8433-5661ad318ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-406140bd-9c89-4b61-b44b-4e54b54f012e tempest-VolumesListTestJSON-536786808 None] Created volume successfully. Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (dd8047e7-1042-4cfc-b74b-eb2bd878bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b08c9-da4b-47f9-9346-f12773fcde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b08c9-da4b-47f9-9346-f12773fcde58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1169932898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fca304-f64e-4a46-9410-662fb345ec47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:39Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e42e705-5846-4627-8593-2c5c0bff7c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e42e705-5846-4627-8593-2c5c0bff7c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f55ef45-ed2e-4992-aa37-3011182f83a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f55ef45-ed2e-4992-aa37-3011182f83a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fca304-f64e-4a46-9410-662fb345ec47', 'volume_name': 'volume-a5fca304-f64e-4a46-9410-662fb345ec47', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711b86fa-bce0-4fd5-8ddb-d6b73cc55bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711b86fa-bce0-4fd5-8ddb-d6b73cc55bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3f1290-84f9-439a-8b93-b3ef25dbef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:39 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Volume a5fca304-f64e-4a46-9410-662fb345ec47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fca304-f64e-4a46-9410-662fb345ec47', 'volume_size': 1} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1169932898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fca304-f64e-4a46-9410-662fb345ec47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc84ad0e1724a7185ca5c562c2fe6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:39Z,use_quota=True,user_id='62408860d87c428c9520566e450b0928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Creating volume a5fca304-f64e-4a46-9410-662fb345ec47 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:39 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 1073741824 Sep 01 02:17:39 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 1073741824" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 Sep 01 02:17:39 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3f1290-84f9-439a-8b93-b3ef25dbef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fca304-f64e-4a46-9410-662fb345ec47', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a0ae7a-13f3-4209-811c-38ccb463f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Volume volume-a5fca304-f64e-4a46-9410-662fb345ec47 (a5fca304-f64e-4a46-9410-662fb345ec47): created successfully Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a0ae7a-13f3-4209-811c-38ccb463f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Flow 'volume_create_manager' (dd8047e7-1042-4cfc-b74b-eb2bd878bacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-57d6f4ea-6765-478e-afee-705ac1e9fa24 tempest-VolumesListTestJSON-536786808 None] Created volume successfully. Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:40 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:17:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-a5fca304-f64e-4a46-9410-662fb345ec47-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-a5fca304-f64e-4a46-9410-662fb345ec47-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-quobyte-a5fca304-f64e-4a46-9410-662fb345ec47" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-a5fca304-f64e-4a46-9410-662fb345ec47" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ba1ee-962d-4385-8eef-ea22adef6875]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 Sep 01 02:17:42 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:42 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47 Sep 01 02:17:42 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a5fca304-f64e-4a46-9410-662fb345ec47" returned: 0 in 0.237s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-a5fca304-f64e-4a46-9410-662fb345ec47" released by "delete_volume" :: held 0.617s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Created reservations ['e2b4c2d8-5902-455a-931e-d62724b4abb6', 'fb8990e5-463a-4453-ab2f-6c96efa41218', '4885654e-8f16-4b54-bada-2a204dcff71c', '71bce71f-61aa-43fc-a597-5ca47d6ea9a7'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:43 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:43 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Deleted volume successfully. Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-74fb85c9-900d-4bb3-84e8-03a939941e74 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-a5fca304-f64e-4a46-9410-662fb345ec47-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-037782bd-3907-4861-8557-7c17891ba498-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-037782bd-3907-4861-8557-7c17891ba498-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-quobyte-037782bd-3907-4861-8557-7c17891ba498" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-037782bd-3907-4861-8557-7c17891ba498" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c11f9-d13c-4070-b470-bc02d42c4f47]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:43 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 Sep 01 02:17:43 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498" returned: 0 in 0.348s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:44 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498 Sep 01 02:17:44 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:44 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-037782bd-3907-4861-8557-7c17891ba498" returned: 0 in 0.257s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-037782bd-3907-4861-8557-7c17891ba498" released by "delete_volume" :: held 0.643s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Created reservations ['0daebc2b-f69a-4c66-849a-6327c8b35d02', 'c742f1e5-1db8-4bc5-967f-15aec6909bd2', 'bc500476-5e98-489c-b9ac-ae79cc5833dc', '4bbfb44e-31a5-40db-9006-17fd1cef5a25'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:44 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:44 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:44 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Deleted volume successfully. Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7709ad4-e6ae-429d-8e4f-799ac5be3b23 tempest-VolumesListTestJSON-536786808 None] Lock "cinder-037782bd-3907-4861-8557-7c17891ba498-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-c8748310-e29a-49ff-9de4-c4377bfa6820-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "cinder-c8748310-e29a-49ff-9de4-c4377bfa6820-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Acquiring lock "cinder-quobyte-c8748310-e29a-49ff-9de4-c4377bfa6820" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-c8748310-e29a-49ff-9de4-c4377bfa6820" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8ddc6-0284-4a26-8b1b-316e49901f9e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:44 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 Sep 01 02:17:44 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:45 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:45 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820 Sep 01 02:17:45 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:45 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c8748310-e29a-49ff-9de4-c4377bfa6820" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "cinder-quobyte-c8748310-e29a-49ff-9de4-c4377bfa6820" released by "delete_volume" :: held 0.638s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Created reservations ['e4aba44b-5c07-43fc-8ed9-28b1f5552ad6', '16c90a44-3eb2-424f-8a01-3b4e2345ad64', '5e77adb1-fa03-4038-87eb-c661f9c9046b', '398fe880-d258-4550-ad43-c5ab6d6b76c3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:45 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:17:45 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:45 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Deleted volume successfully. Sep 01 02:17:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-22d79ad0-4157-4095-9331-c111f5f5389e tempest-VolumesListTestJSON-536786808 None] Lock "cinder-c8748310-e29a-49ff-9de4-c4377bfa6820-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Flow 'volume_create_manager' (56063b96-5926-4b61-bfda-51e133faa0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f4db7d-49f7-4a59-97a8-83c3324da04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f4db7d-49f7-4a59-97a8-83c3324da04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-988219535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e136d24-a111-424b-83e5-6cd004d7533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14c6484f684cfc8b644eb8f76e2212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:49Z,use_quota=True,user_id='ed7913ed98f34dcfaf2b0e9e822b2aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be37b1df-234f-467f-bbd0-82bc0bb50e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be37b1df-234f-467f-bbd0-82bc0bb50e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d0cdaf-bca5-4fb4-bfac-fd22ab3f6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d0cdaf-bca5-4fb4-bfac-fd22ab3f6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e136d24-a111-424b-83e5-6cd004d7533e', 'volume_name': 'volume-5e136d24-a111-424b-83e5-6cd004d7533e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d72392-6711-473b-88ca-d032e130e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d72392-6711-473b-88ca-d032e130e18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0cd1b3-c2b8-4d81-80bc-b38e4e39a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Volume 5e136d24-a111-424b-83e5-6cd004d7533e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e136d24-a111-424b-83e5-6cd004d7533e', 'volume_size': 1} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-988219535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e136d24-a111-424b-83e5-6cd004d7533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14c6484f684cfc8b644eb8f76e2212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:49Z,use_quota=True,user_id='ed7913ed98f34dcfaf2b0e9e822b2aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Creating volume 5e136d24-a111-424b-83e5-6cd004d7533e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:48 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:17:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e 1073741824 Sep 01 02:17:48 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:49 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e 1073741824" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:49 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e Sep 01 02:17:49 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:49 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0cd1b3-c2b8-4d81-80bc-b38e4e39a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e136d24-a111-424b-83e5-6cd004d7533e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef93835-66fc-4c7a-a207-8c5943b6e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Volume volume-5e136d24-a111-424b-83e5-6cd004d7533e (5e136d24-a111-424b-83e5-6cd004d7533e): created successfully Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef93835-66fc-4c7a-a207-8c5943b6e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Flow 'volume_create_manager' (56063b96-5926-4b61-bfda-51e133faa0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4a58b7b1-e8f2-46bc-9231-bd6dc4aaaa85 tempest-VolumesNegativeTest-66465323 None] Created volume successfully. Sep 01 02:17:59 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=65,cinder:INSERT=29,cinder:UPDATE=86,cinder:DELETE=9 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:59 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=85,cinder:DELETE=6,cinder:SELECT=55,cinder:INSERT=23 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Acquiring lock "cinder-5e136d24-a111-424b-83e5-6cd004d7533e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "cinder-5e136d24-a111-424b-83e5-6cd004d7533e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Acquiring lock "cinder-quobyte-5e136d24-a111-424b-83e5-6cd004d7533e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "cinder-quobyte-5e136d24-a111-424b-83e5-6cd004d7533e" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8ad69-28a7-4396-9c36-681a535dce1b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e Sep 01 02:18:06 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e Sep 01 02:18:06 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e136d24-a111-424b-83e5-6cd004d7533e" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "cinder-quobyte-5e136d24-a111-424b-83e5-6cd004d7533e" released by "delete_volume" :: held 0.634s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Created reservations ['59b1fc1c-a4cb-4986-9f6b-feb93b320bf5', 'e1189031-9400-4852-8874-7e762b5ae4e1', '90582550-f049-4fa0-ba75-f8aed5a380b4', 'c9352cce-f344-444b-9e34-f7c791cf45d8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:18:07 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Deleted volume successfully. Sep 01 02:18:07 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29fd0d47-420b-47b5-925b-37de410050a0 tempest-VolumesNegativeTest-66465323 None] Lock "cinder-5e136d24-a111-424b-83e5-6cd004d7533e-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:17 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:17 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (f238797b-31c0-4531-be8f-33a7823cc41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b570d2-3283-4166-84c5-c07da1108be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b570d2-3283-4166-84c5-c07da1108be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1766441699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c162fc5-e0a2-4114-b0ab-1de5a8afe029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:33Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6942700-af93-4a45-b559-48b67fa25d78),volume_type_id=d6942700-af93-4a45-b559-48b67fa25d78)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431b783-3245-45ab-b52d-2fc8c24e1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431b783-3245-45ab-b52d-2fc8c24e1c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a02f9-9ce5-4849-8590-57f740ef808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a02f9-9ce5-4849-8590-57f740ef808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c162fc5-e0a2-4114-b0ab-1de5a8afe029', 'volume_name': 'volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e277de-92ae-431c-9b08-928245a30dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e277de-92ae-431c-9b08-928245a30dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f11312-0a55-40a0-8822-00170a5d6688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume 1c162fc5-e0a2-4114-b0ab-1de5a8afe029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029', 'volume_size': 1} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1766441699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c162fc5-e0a2-4114-b0ab-1de5a8afe029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:33Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6942700-af93-4a45-b559-48b67fa25d78),volume_type_id=d6942700-af93-4a45-b559-48b67fa25d78)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Creating volume 1c162fc5-e0a2-4114-b0ab-1de5a8afe029 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:33 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 1073741824 Sep 01 02:18:33 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (0415678d-ce0f-48ac-8b86-a6b4e65b6433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73346063-77da-4f48-8236-d093eaf98c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73346063-77da-4f48-8236-d093eaf98c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279521980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406716b-b290-4221-b0b9-cab8d9fd4d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:34Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d976e5e7-9e3c-4b44-9032-9fcb9993997e),volume_type_id=d976e5e7-9e3c-4b44-9032-9fcb9993997e)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5379220-6d57-4679-8638-86616ef665fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5379220-6d57-4679-8638-86616ef665fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898180f-1416-497d-81b3-1266157e7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898180f-1416-497d-81b3-1266157e7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd406716b-b290-4221-b0b9-cab8d9fd4d15', 'volume_name': 'volume-d406716b-b290-4221-b0b9-cab8d9fd4d15', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dd2776-83fe-4029-95cf-d614c85b2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dd2776-83fe-4029-95cf-d614c85b2b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e0b1f-8540-4376-92de-6b14aedcb3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume d406716b-b290-4221-b0b9-cab8d9fd4d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d406716b-b290-4221-b0b9-cab8d9fd4d15', 'volume_size': 1} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:33 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 1073741824" returned: 0 in 0.495s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 Sep 01 02:18:33 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" returned: 0 in 0.268s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279521980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406716b-b290-4221-b0b9-cab8d9fd4d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:34Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d976e5e7-9e3c-4b44-9032-9fcb9993997e),volume_type_id=d976e5e7-9e3c-4b44-9032-9fcb9993997e)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Creating volume d406716b-b290-4221-b0b9-cab8d9fd4d15 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:34 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f11312-0a55-40a0-8822-00170a5d6688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b568079-5902-45bc-9303-802332e08088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 1073741824 Sep 01 02:18:34 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 (1c162fc5-e0a2-4114-b0ab-1de5a8afe029): created successfully Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b568079-5902-45bc-9303-802332e08088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (f238797b-31c0-4531-be8f-33a7823cc41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (98e7430e-e9f7-4595-b404-34b2e0c3b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007f8f4d-407f-4dad-8b1d-07ba00f16a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3756e28a-53a6-4954-a993-e9be0b4b250a tempest-TestInstancesWithCinderVolumes-1949058580 None] Created volume successfully. Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007f8f4d-407f-4dad-8b1d-07ba00f16a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1008229072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420c9c3c-7110-40df-8494-1240fba7eab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:34Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5443bd31-219f-488a-870b-44eb01ce9ee0),volume_type_id=5443bd31-219f-488a-870b-44eb01ce9ee0)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a169d-7565-4621-82ca-09522c128d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a169d-7565-4621-82ca-09522c128d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6c6496-247f-4373-96fa-4ebacadaa62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6c6496-247f-4373-96fa-4ebacadaa62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '420c9c3c-7110-40df-8494-1240fba7eab2', 'volume_name': 'volume-420c9c3c-7110-40df-8494-1240fba7eab2', 'volume_size': 1, 'image_id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--694602719', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb6dfa4c70ce4aca9113fa75d3ae6c4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84522bb5-801b-46af-8369-7fdbcbe62b79/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ef7956-f459-4776-a70b-3d120d30153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ef7956-f459-4776-a70b-3d120d30153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a163bb-b2cf-49b0-9550-e27bb07d58fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume 420c9c3c-7110-40df-8494-1240fba7eab2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-420c9c3c-7110-40df-8494-1240fba7eab2', 'volume_size': 1, 'image_id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--694602719', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb6dfa4c70ce4aca9113fa75d3ae6c4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84522bb5-801b-46af-8369-7fdbcbe62b79/file', 'properties': {}}, 'image_service': } Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Trying to clone 420c9c3c-7110-40df-8494-1240fba7eab2 from image 84522bb5-801b-46af-8369-7fdbcbe62b79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:18:34 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 1073741824" returned: 0 in 0.478s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 Sep 01 02:18:34 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15" returned: 0 in 0.319s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e0b1f-8540-4376-92de-6b14aedcb3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d406716b-b290-4221-b0b9-cab8d9fd4d15', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99ffb40-cce5-4aa4-9a22-c0a20c9b0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 (d406716b-b290-4221-b0b9-cab8d9fd4d15): created successfully Sep 01 02:18:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99ffb40-cce5-4aa4-9a22-c0a20c9b0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (0415678d-ce0f-48ac-8b86-a6b4e65b6433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-913c5923-4ff0-41e0-9135-e0ebae62b547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Created volume successfully. Sep 01 02:18:37 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD, size 20.69 MB, duration 2.95 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:18:37 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Image download 20.69 MB at 7.01 MB/s Sep 01 02:18:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffafcaa-d2f5-44f7-b9d7-aa94e0b9294d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD Sep 01 02:18:37 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Temporary image 84522bb5-801b-46af-8369-7fdbcbe62b79 is fetched for user 89dbe51e212746aebc25d158b763d745. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df77f2-2852-4363-9456-dc7ace95b894]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD Sep 01 02:18:38 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1008229072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420c9c3c-7110-40df-8494-1240fba7eab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6dfa4c70ce4aca9113fa75d3ae6c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:34Z,use_quota=True,user_id='89dbe51e212746aebc25d158b763d745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5443bd31-219f-488a-870b-44eb01ce9ee0),volume_type_id=5443bd31-219f-488a-870b-44eb01ce9ee0)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Creating volume 420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:38 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1073741824 Sep 01 02:18:38 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1073741824" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 Sep 01 02:18:38 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Attempting download of 84522bb5-801b-46af-8369-7fdbcbe62b79 ((None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}])) to volume 420c9c3c-7110-40df-8494-1240fba7eab2. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa541887-b001-41e9-81a5-2bb537a15031]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa Sep 01 02:18:39 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa Sep 01 02:18:39 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa" returned: 1 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84522bb5-801b-46af-8369-7fdbcbe62b79_lp4f9vxa' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2d64d-b51f-4689-857c-0cf89e48e084]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD Sep 01 02:18:39 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] 84522bb5-801b-46af-8369-7fdbcbe62b79 was qcow2, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 Sep 01 02:18:40 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:18:40 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:18:41 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2" returned: 0 in 1.576s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84522bb5-801b-46af-8369-7fdbcbe62b79_yqd53mvadevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:41 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Converted 112.00 MB image at 71.01 MB/s Sep 01 02:18:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1G Sep 01 02:18:41 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 1G" returned: 0 in 0.313s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Downloaded image 84522bb5-801b-46af-8369-7fdbcbe62b79 ((None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}])) to volume 420c9c3c-7110-40df-8494-1240fba7eab2 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Temporary image 84522bb5-801b-46af-8369-7fdbcbe62b79 for user 89dbe51e212746aebc25d158b763d745 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Marking volume 420c9c3c-7110-40df-8494-1240fba7eab2 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Copying metadata from image 84522bb5-801b-46af-8369-7fdbcbe62b79 to 420c9c3c-7110-40df-8494-1240fba7eab2. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Creating volume glance metadata for volume 420c9c3c-7110-40df-8494-1240fba7eab2 backed by image 84522bb5-801b-46af-8369-7fdbcbe62b79 with: {'image_id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'image_name': 'tempest-scenario-img--694602719', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a163bb-b2cf-49b0-9550-e27bb07d58fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420c9c3c-7110-40df-8494-1240fba7eab2', 'volume_size': 1, 'image_id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84522bb5-801b-46af-8369-7fdbcbe62b79', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--694602719', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb6dfa4c70ce4aca9113fa75d3ae6c4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84522bb5-801b-46af-8369-7fdbcbe62b79', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84522bb5-801b-46af-8369-7fdbcbe62b79/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336dfac9-a642-4fad-86e5-9317419bb291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:42 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Volume volume-420c9c3c-7110-40df-8494-1240fba7eab2 (420c9c3c-7110-40df-8494-1240fba7eab2): created successfully Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336dfac9-a642-4fad-86e5-9317419bb291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:42 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Flow 'volume_create_manager' (98e7430e-e9f7-4595-b404-34b2e0c3b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e15d9b29-6ff5-44fa-af53-23929999036e tempest-TestInstancesWithCinderVolumes-1949058580 None] Created volume successfully. Sep 01 02:18:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7e15875e-25b0-49e9-9371-ad5504f048f0 req-aeadc8fe-8355-400c-add7-0132b5945446 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7e15875e-25b0-49e9-9371-ad5504f048f0 req-aeadc8fe-8355-400c-add7-0132b5945446 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7e15875e-25b0-49e9-9371-ad5504f048f0 req-aeadc8fe-8355-400c-add7-0132b5945446 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-7e15875e-25b0-49e9-9371-ad5504f048f0 req-aeadc8fe-8355-400c-add7-0132b5945446 tempest-TestInstancesWithCinderVolumes-1949058580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-420c9c3c-7110-40df-8494-1240fba7eab2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c56355af-a8fe-434a-ae1f-87402d7c5e78', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:18:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-7e15875e-25b0-49e9-9371-ad5504f048f0 req-aeadc8fe-8355-400c-add7-0132b5945446 tempest-TestInstancesWithCinderVolumes-1949058580 None] attachment_update completed successfully. Sep 01 02:18:55 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:55 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3715efc6-d224-4d1d-b344-587d69e8ef99 req-c624edc9-0bb0-400b-abcb-1fa3c99fcb78 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3715efc6-d224-4d1d-b344-587d69e8ef99 req-c624edc9-0bb0-400b-abcb-1fa3c99fcb78 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-3715efc6-d224-4d1d-b344-587d69e8ef99 req-c624edc9-0bb0-400b-abcb-1fa3c99fcb78 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-3715efc6-d224-4d1d-b344-587d69e8ef99 req-c624edc9-0bb0-400b-abcb-1fa3c99fcb78 tempest-TestInstancesWithCinderVolumes-1949058580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4969aeb0-7f30-4a88-8e03-f5ef8d063e96', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-3715efc6-d224-4d1d-b344-587d69e8ef99 req-c624edc9-0bb0-400b-abcb-1fa3c99fcb78 tempest-TestInstancesWithCinderVolumes-1949058580 None] attachment_update completed successfully. Sep 01 02:19:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-59647274-6df0-49ca-98f1-3d31d0fc5fbb req-bfbe07e5-1a3f-404b-ab38-d1b41c46a336 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-59647274-6df0-49ca-98f1-3d31d0fc5fbb req-bfbe07e5-1a3f-404b-ab38-d1b41c46a336 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-59647274-6df0-49ca-98f1-3d31d0fc5fbb req-bfbe07e5-1a3f-404b-ab38-d1b41c46a336 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-59647274-6df0-49ca-98f1-3d31d0fc5fbb req-bfbe07e5-1a3f-404b-ab38-d1b41c46a336 tempest-TestInstancesWithCinderVolumes-1949058580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-d406716b-b290-4221-b0b9-cab8d9fd4d15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cd90d84-9bd9-48ab-945b-b3b5fd96a383', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-59647274-6df0-49ca-98f1-3d31d0fc5fbb req-bfbe07e5-1a3f-404b-ab38-d1b41c46a336 tempest-TestInstancesWithCinderVolumes-1949058580 None] attachment_update completed successfully. Sep 01 02:19:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-312c180c-7ea0-4e6a-8232-eaffd75baf89 req-52828877-6c55-4941-9780-6ea51e162dbc tempest-TestInstancesWithCinderVolumes-1949058580 None] Terminate volume connection completed successfully. Sep 01 02:19:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-312c180c-7ea0-4e6a-8232-eaffd75baf89 req-52828877-6c55-4941-9780-6ea51e162dbc tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleting attachment 4969aeb0-7f30-4a88-8e03-f5ef8d063e96. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-1c162fc5-e0a2-4114-b0ab-1de5a8afe029-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-1c162fc5-e0a2-4114-b0ab-1de5a8afe029-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-quobyte-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed10a3b-e2f3-4ac7-a045-36591cef980d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 Sep 01 02:19:25 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:25 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" returned: 0 in 0.374s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029 Sep 01 02:19:25 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:25 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-1c162fc5-e0a2-4114-b0ab-1de5a8afe029" released by "delete_volume" :: held 0.667s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:25 devstack cinder-volume[86925]: WARNING cinder.quota [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256828888-2061232158 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256828888-2061232158, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:25 devstack cinder-volume[86925]: WARNING cinder.quota [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256828888-2061232158 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256828888-2061232158, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Created reservations ['44fdc424-5f0f-4d6f-a3f4-1086de205e19', 'b892c131-a48c-4233-8553-14cffd6ef1b1', 'd2dbce17-4cc8-45b1-8b0c-e1a79d2778f6', '9d08a94a-ac62-4bb5-bcd8-02e621e548f8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:19:25 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleted volume successfully. Sep 01 02:19:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-18013eb7-adc2-4a65-a423-6435547c8a0d tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-1c162fc5-e0a2-4114-b0ab-1de5a8afe029-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-27d328ec-8272-4d47-bd53-b5820888b20f req-dc465df9-cccc-4f67-9d13-65195c08cc72 tempest-TestInstancesWithCinderVolumes-1949058580 None] Terminate volume connection completed successfully. Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-27d328ec-8272-4d47-bd53-b5820888b20f req-dc465df9-cccc-4f67-9d13-65195c08cc72 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleting attachment 2cd90d84-9bd9-48ab-945b-b3b5fd96a383. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-d406716b-b290-4221-b0b9-cab8d9fd4d15-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-d406716b-b290-4221-b0b9-cab8d9fd4d15-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-quobyte-d406716b-b290-4221-b0b9-cab8d9fd4d15" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-d406716b-b290-4221-b0b9-cab8d9fd4d15" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[367828ff-602d-4c54-8632-83d76fe4ef05]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:29 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 Sep 01 02:19:29 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:29 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15" returned: 0 in 0.354s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:29 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15 Sep 01 02:19:29 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:29 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d406716b-b290-4221-b0b9-cab8d9fd4d15" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-d406716b-b290-4221-b0b9-cab8d9fd4d15" released by "delete_volume" :: held 0.667s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:29 devstack cinder-volume[86925]: WARNING cinder.quota [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311531130-1879733506 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311531130-1879733506, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:29 devstack cinder-volume[86925]: WARNING cinder.quota [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311531130-1879733506 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311531130-1879733506, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Created reservations ['027f40aa-22ad-4eef-be22-b437ea0abc18', '99cff55b-6074-4d04-b19a-59c742c365bb', '321c2ead-49bc-48d0-9ee1-beef59639c8f', 'cd2d5cd5-5461-48bc-b167-a44a36776398'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:29 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:19:29 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:29 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleted volume successfully. Sep 01 02:19:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d0e8b7be-4641-4437-9077-13cc46480ff4 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-d406716b-b290-4221-b0b9-cab8d9fd4d15-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-ebd575ea-7922-4f75-82e7-d572927dd48e req-2a99afc5-778a-4de0-a11a-a8f37bdcc996 tempest-TestInstancesWithCinderVolumes-1949058580 None] Terminate volume connection completed successfully. Sep 01 02:19:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-ebd575ea-7922-4f75-82e7-d572927dd48e req-2a99afc5-778a-4de0-a11a-a8f37bdcc996 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleting attachment c56355af-a8fe-434a-ae1f-87402d7c5e78. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-420c9c3c-7110-40df-8494-1240fba7eab2-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-420c9c3c-7110-40df-8494-1240fba7eab2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "cinder-quobyte-420c9c3c-7110-40df-8494-1240fba7eab2" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-420c9c3c-7110-40df-8494-1240fba7eab2" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[73573412-da93-4ae6-8e3b-5d8eeddebe19]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:33 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 Sep 01 02:19:33 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2" returned: 0 in 0.369s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2 Sep 01 02:19:34 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-420c9c3c-7110-40df-8494-1240fba7eab2" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-quobyte-420c9c3c-7110-40df-8494-1240fba7eab2" released by "delete_volume" :: held 0.648s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:34 devstack cinder-volume[86925]: WARNING cinder.quota [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1208460496-2135458165 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1208460496-2135458165, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:34 devstack cinder-volume[86925]: WARNING cinder.quota [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1208460496-2135458165 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1208460496-2135458165, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Created reservations ['7a921d0c-3025-47b2-971b-8161c5668821', '6c825d89-e1a8-400c-8774-4ba1e835c383', '278c7b3a-c789-4165-a8c5-189719f00397', '99b0e5cd-de0c-4311-a997-01bfa08e6720'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:19:34 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.228s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Deleted volume successfully. Sep 01 02:19:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a54d03cd-04c1-41ab-8afb-f396d3aca547 tempest-TestInstancesWithCinderVolumes-1949058580 None] Lock "cinder-420c9c3c-7110-40df-8494-1240fba7eab2-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:40 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:19:40 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:41 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.259s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:19:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:19:44 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:44 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Flow 'volume_create_manager' (8118e908-41d2-4691-a4d1-98079105f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f88e6b9-9508-4a19-a36e-aae4369c5f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f88e6b9-9508-4a19-a36e-aae4369c5f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-762511330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b055779-6f63-41de-86ae-ca08569fa734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b1962cd88240cb87d32b1adbd5ea74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:04Z,use_quota=True,user_id='8e15b04e8a21456385ee4c233a27f1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d48c1bf-d9bf-45dd-83cb-0acd77f4a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d48c1bf-d9bf-45dd-83cb-0acd77f4a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5d097-6262-4332-8b7b-c1df70b16eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5d097-6262-4332-8b7b-c1df70b16eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b055779-6f63-41de-86ae-ca08569fa734', 'volume_name': 'volume-3b055779-6f63-41de-86ae-ca08569fa734', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c94d1b-46b8-4209-bc64-7a8dfbe22525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c94d1b-46b8-4209-bc64-7a8dfbe22525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf0a578-3d93-4e5b-b494-c3979c31f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume 3b055779-6f63-41de-86ae-ca08569fa734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b055779-6f63-41de-86ae-ca08569fa734', 'volume_size': 1} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-762511330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b055779-6f63-41de-86ae-ca08569fa734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b1962cd88240cb87d32b1adbd5ea74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:04Z,use_quota=True,user_id='8e15b04e8a21456385ee4c233a27f1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Creating volume 3b055779-6f63-41de-86ae-ca08569fa734 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:04 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:04 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 1073741824 Sep 01 02:20:04 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Flow 'volume_create_manager' (efb563a4-3d5d-4893-9a0d-b1965c30070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a163b9-153f-4592-a0d1-ea542963004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a163b9-153f-4592-a0d1-ea542963004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1354166804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41023890-a92d-4190-89a0-70f3a75f9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b1962cd88240cb87d32b1adbd5ea74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:05Z,use_quota=True,user_id='8e15b04e8a21456385ee4c233a27f1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1395b9df-22ea-49e7-ada1-557c87218d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1395b9df-22ea-49e7-ada1-557c87218d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2299672e-6908-493b-aca9-b30340782e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2299672e-6908-493b-aca9-b30340782e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41023890-a92d-4190-89a0-70f3a75f9f23', 'volume_name': 'volume-41023890-a92d-4190-89a0-70f3a75f9f23', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb770a42-f5f0-43dd-b305-32726025d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb770a42-f5f0-43dd-b305-32726025d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0680b39d-f590-4232-9fe4-60d9fa92ac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume 41023890-a92d-4190-89a0-70f3a75f9f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41023890-a92d-4190-89a0-70f3a75f9f23', 'volume_size': 1} Sep 01 02:20:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:05 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 1073741824" returned: 0 in 0.462s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:05 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 Sep 01 02:20:05 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:05 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1354166804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41023890-a92d-4190-89a0-70f3a75f9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b1962cd88240cb87d32b1adbd5ea74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:05Z,use_quota=True,user_id='8e15b04e8a21456385ee4c233a27f1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Creating volume 41023890-a92d-4190-89a0-70f3a75f9f23 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:05 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf0a578-3d93-4e5b-b494-c3979c31f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b055779-6f63-41de-86ae-ca08569fa734', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:05 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 1073741824 Sep 01 02:20:05 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede7702-7da3-4265-92ba-f0ce2e1ec06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume volume-3b055779-6f63-41de-86ae-ca08569fa734 (3b055779-6f63-41de-86ae-ca08569fa734): created successfully Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede7702-7da3-4265-92ba-f0ce2e1ec06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Flow 'volume_create_manager' (8118e908-41d2-4691-a4d1-98079105f538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8c364dc9-d595-4afa-80ba-4c4efb9b244a tempest-TestServerVolumeAttachmentScenario-184074020 None] Created volume successfully. Sep 01 02:20:05 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 1073741824" returned: 0 in 0.433s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:05 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 Sep 01 02:20:05 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:06 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0680b39d-f590-4232-9fe4-60d9fa92ac34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41023890-a92d-4190-89a0-70f3a75f9f23', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbb77f1-a359-427e-befb-0324694a6bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Volume volume-41023890-a92d-4190-89a0-70f3a75f9f23 (41023890-a92d-4190-89a0-70f3a75f9f23): created successfully Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbb77f1-a359-427e-befb-0324694a6bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Flow 'volume_create_manager' (efb563a4-3d5d-4893-9a0d-b1965c30070e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5e83b65b-edd0-4545-8b54-ebbc3a7b1189 tempest-TestServerVolumeAttachmentScenario-184074020 None] Created volume successfully. Sep 01 02:20:16 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:16 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b94c607-5ec4-4ac3-86e2-2f85df8ec14c req-3f6c929e-3b91-4684-8c1d-025d197614c8 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b94c607-5ec4-4ac3-86e2-2f85df8ec14c req-3f6c929e-3b91-4684-8c1d-025d197614c8 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-7b94c607-5ec4-4ac3-86e2-2f85df8ec14c req-3f6c929e-3b91-4684-8c1d-025d197614c8 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-7b94c607-5ec4-4ac3-86e2-2f85df8ec14c req-3f6c929e-3b91-4684-8c1d-025d197614c8 tempest-TestServerVolumeAttachmentScenario-184074020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-3b055779-6f63-41de-86ae-ca08569fa734', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e143774d-b9c6-4fa1-b35b-30e2796430c6', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-7b94c607-5ec4-4ac3-86e2-2f85df8ec14c req-3f6c929e-3b91-4684-8c1d-025d197614c8 tempest-TestServerVolumeAttachmentScenario-184074020 None] attachment_update completed successfully. Sep 01 02:20:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a7e641df-4129-460f-b2eb-0be0ce162919 req-ce69c92c-c645-4b27-841f-b33c56032fb5 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a7e641df-4129-460f-b2eb-0be0ce162919 req-ce69c92c-c645-4b27-841f-b33c56032fb5 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-a7e641df-4129-460f-b2eb-0be0ce162919 req-ce69c92c-c645-4b27-841f-b33c56032fb5 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-a7e641df-4129-460f-b2eb-0be0ce162919 req-ce69c92c-c645-4b27-841f-b33c56032fb5 tempest-TestServerVolumeAttachmentScenario-184074020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-41023890-a92d-4190-89a0-70f3a75f9f23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4491410b-5f3d-4032-84a9-3ea60abab35c', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-a7e641df-4129-460f-b2eb-0be0ce162919 req-ce69c92c-c645-4b27-841f-b33c56032fb5 tempest-TestServerVolumeAttachmentScenario-184074020 None] attachment_update completed successfully. Sep 01 02:20:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-fd1326dd-e97a-488a-a736-925dc55c9700 req-a01970aa-e471-411a-9a3d-c9215e242aaa tempest-TestServerVolumeAttachmentScenario-184074020 None] Terminate volume connection completed successfully. Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-fd1326dd-e97a-488a-a736-925dc55c9700 req-a01970aa-e471-411a-9a3d-c9215e242aaa tempest-TestServerVolumeAttachmentScenario-184074020 None] Deleting attachment 4491410b-5f3d-4032-84a9-3ea60abab35c. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:40 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:20:40 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:41 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:20:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-1f656705-b684-496c-8e4a-fee5e565e14e req-fe5e6202-80f4-4182-a1b1-e030b50b705f tempest-TestServerVolumeAttachmentScenario-184074020 None] Terminate volume connection completed successfully. Sep 01 02:20:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-1f656705-b684-496c-8e4a-fee5e565e14e req-fe5e6202-80f4-4182-a1b1-e030b50b705f tempest-TestServerVolumeAttachmentScenario-184074020 None] Deleting attachment e143774d-b9c6-4fa1-b35b-30e2796430c6. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "cinder-41023890-a92d-4190-89a0-70f3a75f9f23-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-41023890-a92d-4190-89a0-70f3a75f9f23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "cinder-quobyte-41023890-a92d-4190-89a0-70f3a75f9f23" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-quobyte-41023890-a92d-4190-89a0-70f3a75f9f23" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353dc25-ad5b-4d09-888f-fd59259c7395]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 Sep 01 02:20:46 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23" returned: 0 in 0.359s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23 Sep 01 02:20:46 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-41023890-a92d-4190-89a0-70f3a75f9f23" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-quobyte-41023890-a92d-4190-89a0-70f3a75f9f23" released by "delete_volume" :: held 0.626s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Created reservations ['05dc1a97-8c3a-4f09-80f7-61962fd4228c', '49d0f5e7-d244-4d5a-92d3-d09e4a8b8c5f', '9c154aa4-baf8-4e9e-bcba-573a83ca4658', '4faecabd-ad91-40f3-84c2-b9eae912498b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:20:47 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Deleted volume successfully. Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0b33e6db-267b-4870-844f-b14651454bda tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-41023890-a92d-4190-89a0-70f3a75f9f23-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "cinder-3b055779-6f63-41de-86ae-ca08569fa734-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-3b055779-6f63-41de-86ae-ca08569fa734-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "cinder-quobyte-3b055779-6f63-41de-86ae-ca08569fa734" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-quobyte-3b055779-6f63-41de-86ae-ca08569fa734" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57f7509-e183-43e8-8cbf-d864b5ce9881]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 Sep 01 02:20:47 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734 Sep 01 02:20:47 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3b055779-6f63-41de-86ae-ca08569fa734" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-quobyte-3b055779-6f63-41de-86ae-ca08569fa734" released by "delete_volume" :: held 0.618s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Created reservations ['4bc11251-e92f-450b-a897-8aa99143e815', 'c812891c-96e7-4711-ab55-9031f6023f97', '3e3adce4-cbda-4e46-8599-3d1bad2e34cd', '62c6d39e-a325-472f-aadc-73714ba53f0f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:20:48 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Deleted volume successfully. Sep 01 02:20:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-57ba0f15-6193-4b36-95d8-b90e8897df93 tempest-TestServerVolumeAttachmentScenario-184074020 None] Lock "cinder-3b055779-6f63-41de-86ae-ca08569fa734-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:58 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:58 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Flow 'volume_create_manager' (cc4d3487-253b-4db7-ba3c-85146d617615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5befa0a-900f-45b8-ba76-174f34ce6f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5befa0a-900f-45b8-ba76-174f34ce6f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-448409382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496fc0d4-6993-4bd3-b705-c060c460896b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba4ac7b11c84408860ed3cdc21d12a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:18Z,use_quota=True,user_id='5acff1ce4d9e49f0bdc5677c80cecb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7c2d39-7573-4320-9ce5-4177aa269220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7c2d39-7573-4320-9ce5-4177aa269220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381365a1-a413-4b6b-89c5-75b81147f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381365a1-a413-4b6b-89c5-75b81147f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496fc0d4-6993-4bd3-b705-c060c460896b', 'volume_name': 'volume-496fc0d4-6993-4bd3-b705-c060c460896b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cff931-5c60-4fc6-8ee4-9129f7d1a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cff931-5c60-4fc6-8ee4-9129f7d1a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c907d8f9-343c-4838-a017-4a6b10fb9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Volume 496fc0d4-6993-4bd3-b705-c060c460896b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496fc0d4-6993-4bd3-b705-c060c460896b', 'volume_size': 1} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-448409382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496fc0d4-6993-4bd3-b705-c060c460896b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba4ac7b11c84408860ed3cdc21d12a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:18Z,use_quota=True,user_id='5acff1ce4d9e49f0bdc5677c80cecb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Creating volume 496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b 1073741824 Sep 01 02:21:18 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b 1073741824" returned: 0 in 0.442s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:21:18 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:19 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c907d8f9-343c-4838-a017-4a6b10fb9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496fc0d4-6993-4bd3-b705-c060c460896b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d48b2-fe4b-4fa0-a859-dd4356463cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Volume volume-496fc0d4-6993-4bd3-b705-c060c460896b (496fc0d4-6993-4bd3-b705-c060c460896b): created successfully Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d48b2-fe4b-4fa0-a859-dd4356463cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Flow 'volume_create_manager' (cc4d3487-253b-4db7-ba3c-85146d617615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-945f43b9-641f-467d-8b86-20a1be007761 tempest-TestStampPattern-1922309815 None] Created volume successfully. Sep 01 02:21:29 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:29 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:40 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:21:40 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:21:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:21:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-adf6faf5-f8fc-40a5-9362-70ef01d423e2 req-3cffc54d-3d6e-4cb0-9ec3-8cdf97a1ceec tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-adf6faf5-f8fc-40a5-9362-70ef01d423e2 req-3cffc54d-3d6e-4cb0-9ec3-8cdf97a1ceec tempest-TestStampPattern-1922309815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-adf6faf5-f8fc-40a5-9362-70ef01d423e2 req-3cffc54d-3d6e-4cb0-9ec3-8cdf97a1ceec tempest-TestStampPattern-1922309815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-adf6faf5-f8fc-40a5-9362-70ef01d423e2 req-3cffc54d-3d6e-4cb0-9ec3-8cdf97a1ceec tempest-TestStampPattern-1922309815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-496fc0d4-6993-4bd3-b705-c060c460896b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b619078-f2cd-4a9e-a7d9-666a77c9614e', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:21:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-adf6faf5-f8fc-40a5-9362-70ef01d423e2 req-3cffc54d-3d6e-4cb0-9ec3-8cdf97a1ceec tempest-TestStampPattern-1922309815 None] attachment_update completed successfully. Sep 01 02:21:51 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-72ba3232-d760-4a3f-928d-bc6d90e42753 req-dddc42d8-a25e-4d59-b673-f85670916fc2 tempest-TestStampPattern-1922309815 None] Terminate volume connection completed successfully. Sep 01 02:21:51 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-72ba3232-d760-4a3f-928d-bc6d90e42753 req-dddc42d8-a25e-4d59-b673-f85670916fc2 tempest-TestStampPattern-1922309815 None] Deleting attachment 2b619078-f2cd-4a9e-a7d9-666a77c9614e. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:21:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Creating offline snapshot 40e39255-672e-4e78-ac83-d3454206b365 of volume 496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:52 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe16b7c-e850-4487-bd8e-7d4e5d3f2a8b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:21:53 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.376s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 1G Sep 01 02:21:53 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 1G" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496fc0d4-6993-4bd3-b705-c060c460896b -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496fc0d4-6993-4bd3-b705-c060c460896b -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:21:53 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496fc0d4-6993-4bd3-b705-c060c460896b -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.283s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 is being set with open permissions: ugo+rw Sep 01 02:21:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:21:54 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info Sep 01 02:21:54 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info" returned: 0 in 0.268s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info is being set with open permissions: ugo+rw Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info Sep 01 02:21:54 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.info" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3dfdd0c7-4b8b-45c1-9973-3fb42533c25a tempest-TestStampPattern-1922309815 None] Create snapshot completed successfully Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Flow 'volume_create_manager' (b4949e24-1de8-420c-93a7-5af399b5ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2863c0c5-9960-45e8-af1a-24089caf9a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2863c0c5-9960-45e8-af1a-24089caf9a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1108934441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02766146-f69a-4213-a894-a2375eca46dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba4ac7b11c84408860ed3cdc21d12a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40e39255-672e-4e78-ac83-d3454206b365,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:02Z,use_quota=True,user_id='5acff1ce4d9e49f0bdc5677c80cecb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569fc8bc-698e-4542-9e1c-53f7f52e5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569fc8bc-698e-4542-9e1c-53f7f52e5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ea932f-b96c-42ce-9540-091398121560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ea932f-b96c-42ce-9540-091398121560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02766146-f69a-4213-a894-a2375eca46dd', 'volume_name': 'volume-02766146-f69a-4213-a894-a2375eca46dd', 'volume_size': 1, 'snapshot_id': '40e39255-672e-4e78-ac83-d3454206b365'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9967cf8-0c71-408a-974a-3fef06c57618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9967cf8-0c71-408a-974a-3fef06c57618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0551a8e9-8d6d-43eb-80b6-c15ef5c7d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Volume 02766146-f69a-4213-a894-a2375eca46dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02766146-f69a-4213-a894-a2375eca46dd', 'volume_size': 1, 'snapshot_id': '40e39255-672e-4e78-ac83-d3454206b365'} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365-02766146-f69a-4213-a894-a2375eca46dd" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365-02766146-f69a-4213-a894-a2375eca46dd" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Creating volume 02766146-f69a-4213-a894-a2375eca46dd from snapshot 40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] snapshot: 40e39255-672e-4e78-ac83-d3454206b365, volume: 02766146-f69a-4213-a894-a2375eca46dd, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c121464-2734-42b4-9539-ac7903e03898]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:22:02 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.397s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496fc0d4-6993-4bd3-b705-c060c460896b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536a80c-4611-4a0f-bb1e-182e6ef842c5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:22:02 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:22:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd Sep 01 02:22:02 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:08 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd" returned: 0 in 5.893s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:22:08 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Converted 1024.00 MB image at 173.73 MB/s Sep 01 02:22:08 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd is being set with open permissions: ugo+rw Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:08 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd Sep 01 02:22:08 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:08 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd" returned: 0 in 0.285s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" released by "_copy_volume_from_snapshot" :: held 7.084s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365-02766146-f69a-4213-a894-a2375eca46dd" released by "_create_volume_from_snapshot" :: held 7.163s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.184s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0551a8e9-8d6d-43eb-80b6-c15ef5c7d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02766146-f69a-4213-a894-a2375eca46dd', 'volume_size': 1, 'snapshot_id': '40e39255-672e-4e78-ac83-d3454206b365'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:08 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841036db-d183-431b-9a07-c1a6904cde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Volume volume-02766146-f69a-4213-a894-a2375eca46dd (02766146-f69a-4213-a894-a2375eca46dd): created successfully Sep 01 02:22:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841036db-d183-431b-9a07-c1a6904cde3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Flow 'volume_create_manager' (b4949e24-1de8-420c-93a7-5af399b5ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5e0144a2-9c5a-4151-8178-264685368bf9 tempest-TestStampPattern-1922309815 None] Created volume successfully. Sep 01 02:22:19 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:19 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f9e7e827-41c3-482d-b35f-fbe4d673fb3b req-3e13f1be-7a8d-43ea-a96f-f4eb819b7e64 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f9e7e827-41c3-482d-b35f-fbe4d673fb3b req-3e13f1be-7a8d-43ea-a96f-f4eb819b7e64 tempest-TestStampPattern-1922309815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [req-f9e7e827-41c3-482d-b35f-fbe4d673fb3b req-3e13f1be-7a8d-43ea-a96f-f4eb819b7e64 tempest-TestStampPattern-1922309815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-f9e7e827-41c3-482d-b35f-fbe4d673fb3b req-3e13f1be-7a8d-43ea-a96f-f4eb819b7e64 tempest-TestStampPattern-1922309815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95', 'name': 'volume-02766146-f69a-4213-a894-a2375eca46dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea06bd37-ee2a-4187-90e0-31dca1f6f319', 'enforce_multipath': True} {{(pid=86925) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:22:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-f9e7e827-41c3-482d-b35f-fbe4d673fb3b req-3e13f1be-7a8d-43ea-a96f-f4eb819b7e64 tempest-TestStampPattern-1922309815 None] attachment_update completed successfully. Sep 01 02:22:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [req-fac65a52-a7d4-4eb7-9d18-7f2dbe31b160 req-cdd02d2f-9ddc-4914-9fd6-d489e57a4e71 tempest-TestStampPattern-1922309815 None] Terminate volume connection completed successfully. Sep 01 02:22:39 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [req-fac65a52-a7d4-4eb7-9d18-7f2dbe31b160 req-cdd02d2f-9ddc-4914-9fd6-d489e57a4e71 tempest-TestStampPattern-1922309815 None] Deleting attachment ea06bd37-ee2a-4187-90e0-31dca1f6f319. {{(pid=86925) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:40 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:22:40 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:22:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:22:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-02766146-f69a-4213-a894-a2375eca46dd-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "cinder-02766146-f69a-4213-a894-a2375eca46dd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae854cb-f3d8-4ead-a778-abaa9930b193]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd Sep 01 02:22:44 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd" returned: 0 in 0.361s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd Sep 01 02:22:44 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-02766146-f69a-4213-a894-a2375eca46dd" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-02766146-f69a-4213-a894-a2375eca46dd" released by "delete_volume" :: held 0.634s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Created reservations ['7b67907d-a575-421d-9379-8d083af9c694', 'bda17d36-2f43-4aa8-80c4-79f36415ae9d', '506e04c3-b04a-4c70-ad30-e7b4f5e939f3', '6a9033ef-f601-4d9d-b0b8-3b9a5ef352d8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:22:44 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Deleted volume successfully. Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d8ad978-5d29-481b-a0ee-df76f9dd438e tempest-TestStampPattern-1922309815 None] Lock "cinder-02766146-f69a-4213-a894-a2375eca46dd-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-40e39255-672e-4e78-ac83-d3454206b365-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-40e39255-672e-4e78-ac83-d3454206b365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Deleting offline snapshot 40e39255-672e-4e78-ac83-d3454206b365 of volume 496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] snapshot_file for this snap is: volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[64476ccc-ff1d-463f-8a26-8741690997bc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:45 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:22:45 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496fc0d4-6993-4bd3-b705-c060c460896b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79ad04-ba1b-4b63-9344-d2c40aca08ef]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:45 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:22:45 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:46 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.491s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:22:46 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:46 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365 Sep 01 02:22:46 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:46 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b.40e39255-672e-4e78-ac83-d3454206b365" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-40e39255-672e-4e78-ac83-d3454206b365" released by "_delete_snapshot" :: held 1.492s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" released by "delete_snapshot" :: held 1.513s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Created reservations ['6c2e1d40-2f7d-460d-85a3-f45175801c82', '20589472-3b2f-4d04-8509-a668978e111e', 'f1d68e95-fe1c-49a7-aa4a-dae3ec54d284', 'd86e85c6-7774-4cb9-83c9-94fce6ce678e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Delete snapshot completed successfully. Sep 01 02:22:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eb2dccff-4134-41e1-8e39-ae847226853c tempest-TestStampPattern-1922309815 None] Lock "cinder-40e39255-672e-4e78-ac83-d3454206b365-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-496fc0d4-6993-4bd3-b705-c060c460896b-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "cinder-496fc0d4-6993-4bd3-b705-c060c460896b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Acquiring lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c8b2f-568d-4b5c-a2ee-aff8afbf3484]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:51 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:22:51 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:51 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:51 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b Sep 01 02:22:51 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:51 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-496fc0d4-6993-4bd3-b705-c060c460896b" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "cinder-quobyte-496fc0d4-6993-4bd3-b705-c060c460896b" released by "delete_volume" :: held 0.635s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Created reservations ['e5518fd7-d8cd-4b47-99b7-10d6ae17b5bb', 'e7ec4d0c-cab8-4f01-a8c0-8b2d564767a9', '2e5df796-863f-449c-bae3-7b77d877d96b', '414c6724-0776-499c-885c-b94ea4fde68b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:51 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:22:51 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:52 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Deleted volume successfully. Sep 01 02:22:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-92db4e73-c2e4-469f-a74a-15acd6301f79 tempest-TestStampPattern-1922309815 None] Lock "cinder-496fc0d4-6993-4bd3-b705-c060c460896b-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:01 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=24,cinder:SELECT=22,cinder:INSERT=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:02 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (cd194e34-8834-4fd3-a754-a990f7bbca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f65902-93e1-4b2a-8757-34af77b3fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f65902-93e1-4b2a-8757-34af77b3fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028708029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bcec49-7da9-49d1-b553-56ba6b5ffdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e003f944-637d-492b-9c85-f7d9f62c9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e003f944-637d-492b-9c85-f7d9f62c9b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa3f7b9-9714-42b4-8b0a-765c777b9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa3f7b9-9714-42b4-8b0a-765c777b9b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bcec49-7da9-49d1-b553-56ba6b5ffdff', 'volume_name': 'volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa68ef2-1589-4dd7-8029-b9a0b54177e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa68ef2-1589-4dd7-8029-b9a0b54177e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a0e0c3-aaf1-4a41-bcf9-0b79ef726f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Volume 24bcec49-7da9-49d1-b553-56ba6b5ffdff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff', 'volume_size': 1} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028708029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bcec49-7da9-49d1-b553-56ba6b5ffdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Creating volume 24bcec49-7da9-49d1-b553-56ba6b5ffdff {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:03 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff 1073741824 Sep 01 02:23:03 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (6643d761-9d84-454a-82b6-f632e6332fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e2748f-7c4a-4294-b3bf-865b3d491a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e2748f-7c4a-4294-b3bf-865b3d491a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282332893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b264ed04-68d6-4e55-a40a-889914ead510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bce8e5-a1e8-4a4e-8542-5bcd2af28d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bce8e5-a1e8-4a4e-8542-5bcd2af28d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879f5b7-7d07-4137-b39d-567495c0e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879f5b7-7d07-4137-b39d-567495c0e020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b264ed04-68d6-4e55-a40a-889914ead510', 'volume_name': 'volume-b264ed04-68d6-4e55-a40a-889914ead510', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2460f767-b3d7-469e-b94a-f3fb423a871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2460f767-b3d7-469e-b94a-f3fb423a871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91828566-0859-4001-935c-2dc5bef3e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Volume b264ed04-68d6-4e55-a40a-889914ead510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b264ed04-68d6-4e55-a40a-889914ead510', 'volume_size': 1} Sep 01 02:23:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff 1073741824" returned: 0 in 0.540s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff Sep 01 02:23:04 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (ac9927da-568b-4673-9975-138d9e2abe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af5992d-9fe5-4e05-9bc6-207409406084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af5992d-9fe5-4e05-9bc6-207409406084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612624208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff98a43d-af50-48bb-a8d2-fa4d5a483003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4780c8be-83e0-4528-b994-6f6245129224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4780c8be-83e0-4528-b994-6f6245129224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc79d9-bd6e-47d6-8495-a7964b68aac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc79d9-bd6e-47d6-8495-a7964b68aac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff98a43d-af50-48bb-a8d2-fa4d5a483003', 'volume_name': 'volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6051d3b-d7b5-47ff-bf43-b83f915b77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6051d3b-d7b5-47ff-bf43-b83f915b77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f20da04-e52c-4101-9ccd-363b51a39a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Volume ff98a43d-af50-48bb-a8d2-fa4d5a483003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282332893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b264ed04-68d6-4e55-a40a-889914ead510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Creating volume b264ed04-68d6-4e55-a40a-889914ead510 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a0e0c3-aaf1-4a41-bcf9-0b79ef726f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 1073741824 Sep 01 02:23:04 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086d92a1-d45a-4c9c-83cf-fa29d81b0887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Volume volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff (24bcec49-7da9-49d1-b553-56ba6b5ffdff): created successfully Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086d92a1-d45a-4c9c-83cf-fa29d81b0887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (cd194e34-8834-4fd3-a754-a990f7bbca59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d1a8beaa-e57b-4300-b278-d02ac2eaf7e8 tempest-CreateVolumesFromImageTest-184012251 None] Created volume successfully. Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (c83ecb26-3445-4d86-b5dc-a069d3841f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289cdc22-26f7-417f-85e6-054f5c165592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289cdc22-26f7-417f-85e6-054f5c165592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641061737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb95e40-2759-4583-b071-86a4195f6b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:05Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127236d0-bcd0-404f-9460-4745341d9db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127236d0-bcd0-404f-9460-4745341d9db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e43fb93-19bd-40f1-a0cc-6968934d4a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e43fb93-19bd-40f1-a0cc-6968934d4a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb95e40-2759-4583-b071-86a4195f6b32', 'volume_name': 'volume-1bb95e40-2759-4583-b071-86a4195f6b32', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd03c6b-bc0c-4f0d-9b88-000b4146c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd03c6b-bc0c-4f0d-9b88-000b4146c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a40a8d9-d14c-4181-8ca9-e5e5ed22ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Volume 1bb95e40-2759-4583-b071-86a4195f6b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb95e40-2759-4583-b071-86a4195f6b32', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 1073741824" returned: 0 in 0.450s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (572b1daf-8b64-4548-90b7-7e862cc1d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d270c87a-f90d-482a-9243-759ba88f5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 Sep 01 02:23:04 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d270c87a-f90d-482a-9243-759ba88f5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092914716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d302c0a7-c2ad-4277-b39c-faa20f528d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:05Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ba7c4-528a-48bf-8208-b33b621e8f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ba7c4-528a-48bf-8208-b33b621e8f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc21144-16e3-4b99-aebe-a2339257bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc21144-16e3-4b99-aebe-a2339257bd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd302c0a7-c2ad-4277-b39c-faa20f528d1f', 'volume_name': 'volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d495286-985b-4677-97b0-4286d9497ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d495286-985b-4677-97b0-4286d9497ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c61d9b-c557-4700-83e4-6114a2384cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Volume d302c0a7-c2ad-4277-b39c-faa20f528d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:05 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612624208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff98a43d-af50-48bb-a8d2-fa4d5a483003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Creating volume ff98a43d-af50-48bb-a8d2-fa4d5a483003 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91828566-0859-4001-935c-2dc5bef3e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b264ed04-68d6-4e55-a40a-889914ead510', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9e9c2b-7b46-4dce-96d5-abbd88660049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:05 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 1073741824 Sep 01 02:23:05 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Volume volume-b264ed04-68d6-4e55-a40a-889914ead510 (b264ed04-68d6-4e55-a40a-889914ead510): created successfully Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9e9c2b-7b46-4dce-96d5-abbd88660049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (6643d761-9d84-454a-82b6-f632e6332fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-60401fa0-6d03-4ae3-b270-e6078bcfce84 tempest-CreateVolumesFromImageTest-184012251 None] Created volume successfully. Sep 01 02:23:05 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 1073741824" returned: 0 in 0.386s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 Sep 01 02:23:05 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003" returned: 0 in 0.237s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641061737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb95e40-2759-4583-b071-86a4195f6b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:05Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Creating volume 1bb95e40-2759-4583-b071-86a4195f6b32 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f20da04-e52c-4101-9ccd-363b51a39a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 1073741824 Sep 01 02:23:05 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49f58d-84b2-47b4-857c-eb5d5539b5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Volume volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 (ff98a43d-af50-48bb-a8d2-fa4d5a483003): created successfully Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49f58d-84b2-47b4-857c-eb5d5539b5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (ac9927da-568b-4673-9975-138d9e2abe49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-36798fc0-32ac-40b9-b1b6-d6393fe5cd4d tempest-CreateVolumesFromImageTest-184012251 None] Created volume successfully. Sep 01 02:23:06 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 1073741824" returned: 0 in 0.422s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 Sep 01 02:23:06 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32" returned: 0 in 0.226s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092914716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d302c0a7-c2ad-4277-b39c-faa20f528d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b59b055613420789bea755901b4827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:05Z,use_quota=True,user_id='f93babc47f534bc096d5869d8ec22bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Creating volume d302c0a7-c2ad-4277-b39c-faa20f528d1f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:06 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a40a8d9-d14c-4181-8ca9-e5e5ed22ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb95e40-2759-4583-b071-86a4195f6b32', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f 1073741824 Sep 01 02:23:06 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba3f97c-b892-46d7-bdbf-537e1a74b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Volume volume-1bb95e40-2759-4583-b071-86a4195f6b32 (1bb95e40-2759-4583-b071-86a4195f6b32): created successfully Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba3f97c-b892-46d7-bdbf-537e1a74b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (c83ecb26-3445-4d86-b5dc-a069d3841f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7fbeaa72-8bf5-4a04-b12d-b871e10d7e2e tempest-CreateVolumesFromImageTest-184012251 None] Created volume successfully. Sep 01 02:23:06 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f 1073741824" returned: 0 in 0.381s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f Sep 01 02:23:06 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] <== create_volume: return (646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c61d9b-c557-4700-83e4-6114a2384cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3577df5-1398-4e4e-9a93-e36e59499339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:07 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Volume volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f (d302c0a7-c2ad-4277-b39c-faa20f528d1f): created successfully Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3577df5-1398-4e4e-9a93-e36e59499339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Flow 'volume_create_manager' (572b1daf-8b64-4548-90b7-7e862cc1d75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:07 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ec82be2e-3637-40d5-b6b0-5cac3c31a43e tempest-CreateVolumesFromImageTest-184012251 None] Created volume successfully. Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-d302c0a7-c2ad-4277-b39c-faa20f528d1f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-d302c0a7-c2ad-4277-b39c-faa20f528d1f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-quobyte-d302c0a7-c2ad-4277-b39c-faa20f528d1f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-d302c0a7-c2ad-4277-b39c-faa20f528d1f" acquired by "delete_volume" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bdc924-efc0-49e8-9e99-12ef92383894]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f Sep 01 02:23:08 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f Sep 01 02:23:08 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d302c0a7-c2ad-4277-b39c-faa20f528d1f" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-d302c0a7-c2ad-4277-b39c-faa20f528d1f" released by "delete_volume" :: held 0.605s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:08 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Created reservations ['89e4af42-f256-41b9-958f-71bcfd864dd3', '2deaf806-b9b4-4392-a442-c4c54db210e8', '191bcfb7-1dec-445a-b671-1410136a0a28', '8a9cabfb-06d5-4ee1-8e89-3e9578e28fdc'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:09 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.224s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Deleted volume successfully. Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c40535f6-ce09-4bd7-baf9-4492f328857b tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-d302c0a7-c2ad-4277-b39c-faa20f528d1f-delete_volume" released by "delete_volume" :: held 1.009s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-1bb95e40-2759-4583-b071-86a4195f6b32-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-1bb95e40-2759-4583-b071-86a4195f6b32-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-quobyte-1bb95e40-2759-4583-b071-86a4195f6b32" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-1bb95e40-2759-4583-b071-86a4195f6b32" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51271e6-704a-4932-8920-85e4ae2940d0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 Sep 01 02:23:09 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32 Sep 01 02:23:09 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1bb95e40-2759-4583-b071-86a4195f6b32" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-1bb95e40-2759-4583-b071-86a4195f6b32" released by "delete_volume" :: held 0.616s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Created reservations ['456cc39f-65b1-4b94-9a38-c15f4d82bfbc', '914796bb-c106-4db2-9317-ff3171ecdca2', '8cdf4ec7-57f1-4e7a-bc26-4052d6d37852', 'b49bc569-8c34-4e04-bfa1-0123a0c0daa0'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:10 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.222s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Deleted volume successfully. Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d7e87e15-01a7-41b3-98be-58399fb4c7e2 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-1bb95e40-2759-4583-b071-86a4195f6b32-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-ff98a43d-af50-48bb-a8d2-fa4d5a483003-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-ff98a43d-af50-48bb-a8d2-fa4d5a483003-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-quobyte-ff98a43d-af50-48bb-a8d2-fa4d5a483003" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-ff98a43d-af50-48bb-a8d2-fa4d5a483003" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa82509-23f9-4bce-bc77-75dd846b7b97]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 Sep 01 02:23:10 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003 Sep 01 02:23:11 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-ff98a43d-af50-48bb-a8d2-fa4d5a483003" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-ff98a43d-af50-48bb-a8d2-fa4d5a483003" released by "delete_volume" :: held 0.615s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Created reservations ['b32ef989-e860-4644-9703-26deb5db6b59', '9af87043-c561-4e79-b8b5-21a6db668ddc', 'b9afc992-6993-4418-90f7-ced2dad62487', '7065f1f8-3dc6-4047-994c-6d10c72a2f7c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:11 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.228s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Deleted volume successfully. Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b209f4ac-6724-4502-9d7f-48ba841e3a09 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-ff98a43d-af50-48bb-a8d2-fa4d5a483003-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-b264ed04-68d6-4e55-a40a-889914ead510-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-b264ed04-68d6-4e55-a40a-889914ead510-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-quobyte-b264ed04-68d6-4e55-a40a-889914ead510" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-b264ed04-68d6-4e55-a40a-889914ead510" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[33748c4c-c866-4a3d-8a32-21cbf94c98ba]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 Sep 01 02:23:11 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:12 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510 Sep 01 02:23:12 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b264ed04-68d6-4e55-a40a-889914ead510" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-b264ed04-68d6-4e55-a40a-889914ead510" released by "delete_volume" :: held 0.661s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Created reservations ['04f16534-c6d0-4b3d-9d6d-bd51cd8045fa', '3bcafa43-2431-46d4-99b0-8946fe0fa59e', '8e5e56bf-e048-4b7a-a6e4-62cb403f5d1e', 'ddd79bda-b8a3-478a-9a1e-aaa6c1ff982f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:12 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:12 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Deleted volume successfully. Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-e6b62518-4812-4ccc-955e-fe810b0a1794 tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-b264ed04-68d6-4e55-a40a-889914ead510-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-24bcec49-7da9-49d1-b553-56ba6b5ffdff-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-24bcec49-7da9-49d1-b553-56ba6b5ffdff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "cinder-quobyte-24bcec49-7da9-49d1-b553-56ba6b5ffdff" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-24bcec49-7da9-49d1-b553-56ba6b5ffdff" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c727fb1-219d-4378-bab2-c8ff927fa7ae]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff Sep 01 02:23:13 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff" returned: 0 in 0.352s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff Sep 01 02:23:13 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-24bcec49-7da9-49d1-b553-56ba6b5ffdff" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-quobyte-24bcec49-7da9-49d1-b553-56ba6b5ffdff" released by "delete_volume" :: held 0.622s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Created reservations ['26863d4f-171d-47aa-be37-572df0c44fca', '61618b69-a6c0-4fa5-aea2-0d0eeea55f83', '7f29b11c-282e-436b-a2b6-375d75dfe24f', 'f549633e-f8ce-4047-af74-e1a05449dcc3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:13 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Deleted volume successfully. Sep 01 02:23:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a6263ae3-79ea-459b-bf68-49ebf3af2ebd tempest-CreateVolumesFromImageTest-184012251 None] Lock "cinder-24bcec49-7da9-49d1-b553-56ba6b5ffdff-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (bdc8e446-f5b5-45cb-9e86-29371045fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3149fa-38bf-42c4-98ad-8d158e6b1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3149fa-38bf-42c4-98ad-8d158e6b1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987184209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c13f28-4f76-4e90-b5fb-058ac99f7482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:17Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b338b14-9c42-4ee9-b78a-92ae2f4551b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b338b14-9c42-4ee9-b78a-92ae2f4551b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3917c3-3241-460e-8b92-af31d42e1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3917c3-3241-460e-8b92-af31d42e1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c13f28-4f76-4e90-b5fb-058ac99f7482', 'volume_name': 'volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908123e1-feaa-435c-b286-264e63606a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908123e1-feaa-435c-b286-264e63606a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca35bcb-4047-43c7-a428-b790c86d17de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume a3c13f28-4f76-4e90-b5fb-058ac99f7482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482', 'volume_size': 1} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987184209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c13f28-4f76-4e90-b5fb-058ac99f7482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:17Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume a3c13f28-4f76-4e90-b5fb-058ac99f7482 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:16 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 1073741824 Sep 01 02:23:16 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 1073741824" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 Sep 01 02:23:17 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca35bcb-4047-43c7-a428-b790c86d17de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3492def4-048e-4134-844c-00dccac4f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 (a3c13f28-4f76-4e90-b5fb-058ac99f7482): created successfully Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3492def4-048e-4134-844c-00dccac4f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (bdc8e446-f5b5-45cb-9e86-29371045fc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d69e087e-20e8-43e5-8555-286d5d29e226 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (41efae3f-a717-42c4-9e89-d65c28d695b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be03e43d-e779-4e45-927f-c48230f76772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be03e43d-e779-4e45-927f-c48230f76772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281372889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19565855-7294-4062-b97e-ad90ef17674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02329944-b240-47fc-bad7-4f4aa961e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02329944-b240-47fc-bad7-4f4aa961e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0bb531-6bab-4713-aa4e-f7ef5b283614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0bb531-6bab-4713-aa4e-f7ef5b283614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19565855-7294-4062-b97e-ad90ef17674a', 'volume_name': 'volume-19565855-7294-4062-b97e-ad90ef17674a', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3dcdb-2654-42f4-a8c2-41e158ce023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3dcdb-2654-42f4-a8c2-41e158ce023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5310cacd-5ecf-485d-8824-1284b8d7d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume 19565855-7294-4062-b97e-ad90ef17674a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19565855-7294-4062-b97e-ad90ef17674a', 'volume_size': 1} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281372889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19565855-7294-4062-b97e-ad90ef17674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume 19565855-7294-4062-b97e-ad90ef17674a {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a 1073741824 Sep 01 02:23:18 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (b3a9bd18-c048-418c-ab51-dfeba8c14ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3e2e66-13f2-4622-9bb7-3cded3c666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3e2e66-13f2-4622-9bb7-3cded3c666ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375904725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8ee27d-6cd1-48e6-944c-2d972c911982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45eddef-7134-498c-a960-4bc4c53ed9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45eddef-7134-498c-a960-4bc4c53ed9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a6adda-4c11-4305-b2ec-514156e25001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a6adda-4c11-4305-b2ec-514156e25001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8ee27d-6cd1-48e6-944c-2d972c911982', 'volume_name': 'volume-8a8ee27d-6cd1-48e6-944c-2d972c911982', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c99bfa-3e47-471c-b619-d75a44dbde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c99bfa-3e47-471c-b619-d75a44dbde71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d5faf4-7362-4283-af3d-20af11e0e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume 8a8ee27d-6cd1-48e6-944c-2d972c911982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8ee27d-6cd1-48e6-944c-2d972c911982', 'volume_size': 1} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a 1073741824" returned: 0 in 0.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a Sep 01 02:23:18 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (0aca78c0-521c-44af-b463-fca7d223a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2632f7-4df2-41e8-ae13-bd0199f134ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2632f7-4df2-41e8-ae13-bd0199f134ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872713072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:19Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3145a-63b7-4be2-8b6e-350b5481ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3145a-63b7-4be2-8b6e-350b5481ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b37a676-9279-450d-85a2-95a3abb67370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b37a676-9279-450d-85a2-95a3abb67370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c', 'volume_name': 'volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b00b45-e208-49ff-9ba1-68b70e2b3669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b00b45-e208-49ff-9ba1-68b70e2b3669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c2fe2e-05ba-4f53-bb59-1d1394b4a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume 97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c', 'volume_size': 1} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a" returned: 0 in 0.278s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375904725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8ee27d-6cd1-48e6-944c-2d972c911982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume 8a8ee27d-6cd1-48e6-944c-2d972c911982 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 1073741824 Sep 01 02:23:19 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5310cacd-5ecf-485d-8824-1284b8d7d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19565855-7294-4062-b97e-ad90ef17674a', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7509d69e-5be8-48b3-9d1e-28acf0e38c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-19565855-7294-4062-b97e-ad90ef17674a (19565855-7294-4062-b97e-ad90ef17674a): created successfully Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7509d69e-5be8-48b3-9d1e-28acf0e38c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (41efae3f-a717-42c4-9e89-d65c28d695b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-308cc747-1d66-4b46-bfaa-3c4bd8afd8f0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (9d02e120-4e4e-4b4d-b1bc-f4f87ee3f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dedb75-e7a9-45ba-87a6-fb4f166deeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dedb75-e7a9-45ba-87a6-fb4f166deeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605124784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fda7ef-da28-4f58-b524-20604d63917b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:19Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11d4226-69d9-4f48-bd2f-ab251cd47030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11d4226-69d9-4f48-bd2f-ab251cd47030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c71c31-cd91-4fd6-aa01-4bb21d81277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c71c31-cd91-4fd6-aa01-4bb21d81277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fda7ef-da28-4f58-b524-20604d63917b', 'volume_name': 'volume-01fda7ef-da28-4f58-b524-20604d63917b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd54bb-c9e6-4933-bf9d-43978d75a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd54bb-c9e6-4933-bf9d-43978d75a294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d747bebb-5fd3-4cd6-a10e-851c90e76842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume 01fda7ef-da28-4f58-b524-20604d63917b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fda7ef-da28-4f58-b524-20604d63917b', 'volume_size': 1} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 1073741824" returned: 0 in 0.509s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 Sep 01 02:23:19 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (a075071c-122f-4942-b839-31575ac0b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826ff006-2e3e-4e8e-ac33-72988659e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826ff006-2e3e-4e8e-ac33-72988659e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063491636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f510ffa-19bc-4907-8317-9ecb28d9166e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:20Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce62993-7c3e-436e-9b9a-c9249eb9eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce62993-7c3e-436e-9b9a-c9249eb9eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0f8b95-7957-40ae-89bd-d434e25d2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0f8b95-7957-40ae-89bd-d434e25d2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f510ffa-19bc-4907-8317-9ecb28d9166e', 'volume_name': 'volume-0f510ffa-19bc-4907-8317-9ecb28d9166e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2a5f7-5a6b-4d35-824f-952077b794a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2a5f7-5a6b-4d35-824f-952077b794a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d008f32-3df3-44dc-8231-bddc2bd3fd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume 0f510ffa-19bc-4907-8317-9ecb28d9166e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f510ffa-19bc-4907-8317-9ecb28d9166e', 'volume_size': 1} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872713072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:19Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume 97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d5faf4-7362-4283-af3d-20af11e0e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8ee27d-6cd1-48e6-944c-2d972c911982', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c 1073741824 Sep 01 02:23:19 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13d3770-5026-48fd-b73c-94cbbbfa4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 (8a8ee27d-6cd1-48e6-944c-2d972c911982): created successfully Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13d3770-5026-48fd-b73c-94cbbbfa4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (b3a9bd18-c048-418c-ab51-dfeba8c14ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c96faf4c-ee64-4d23-b460-5802efcf31cb tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:20 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c 1073741824" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c Sep 01 02:23:20 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605124784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fda7ef-da28-4f58-b524-20604d63917b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:19Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume 01fda7ef-da28-4f58-b524-20604d63917b {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:20 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b 1073741824 Sep 01 02:23:20 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c2fe2e-05ba-4f53-bb59-1d1394b4a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e44a18-eaf2-40e7-91c7-bf0101c5d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c (97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c): created successfully Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e44a18-eaf2-40e7-91c7-bf0101c5d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (0aca78c0-521c-44af-b463-fca7d223a019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5d8d40bf-fa74-44f8-a70d-00b8b5d30ce6 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:20 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b 1073741824" returned: 0 in 0.447s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b Sep 01 02:23:21 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063491636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f510ffa-19bc-4907-8317-9ecb28d9166e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01083e892444cf289d6988a5b59bbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:20Z,use_quota=True,user_id='4e2f9ee5cb824e409001fff4e045d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Creating volume 0f510ffa-19bc-4907-8317-9ecb28d9166e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:21 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d747bebb-5fd3-4cd6-a10e-851c90e76842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fda7ef-da28-4f58-b524-20604d63917b', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e 1073741824 Sep 01 02:23:21 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e687b5e-6ebf-4357-9f8a-a2ec92a2005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-01fda7ef-da28-4f58-b524-20604d63917b (01fda7ef-da28-4f58-b524-20604d63917b): created successfully Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e687b5e-6ebf-4357-9f8a-a2ec92a2005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (9d02e120-4e4e-4b4d-b1bc-f4f87ee3f173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5ae3a04b-2991-49ee-bf15-c80cb24afbc0 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:21 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e 1073741824" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e Sep 01 02:23:21 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d008f32-3df3-44dc-8231-bddc2bd3fd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f510ffa-19bc-4907-8317-9ecb28d9166e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adfa935-82f8-44fe-9b6a-431036d33d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Volume volume-0f510ffa-19bc-4907-8317-9ecb28d9166e (0f510ffa-19bc-4907-8317-9ecb28d9166e): created successfully Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adfa935-82f8-44fe-9b6a-431036d33d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Flow 'volume_create_manager' (a075071c-122f-4942-b839-31575ac0b217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-1ed6448d-9107-4518-b88e-883960e82a9d tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created volume successfully. Sep 01 02:23:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-0f510ffa-19bc-4907-8317-9ecb28d9166e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-0f510ffa-19bc-4907-8317-9ecb28d9166e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-0f510ffa-19bc-4907-8317-9ecb28d9166e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-0f510ffa-19bc-4907-8317-9ecb28d9166e" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1b4bbd-1bc3-4384-a553-fcc2bc842562]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e Sep 01 02:23:23 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e Sep 01 02:23:23 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0f510ffa-19bc-4907-8317-9ecb28d9166e" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-0f510ffa-19bc-4907-8317-9ecb28d9166e" released by "delete_volume" :: held 0.638s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['0f62a72e-8b07-4a51-9158-79d94ada3dfc', 'd610262d-deed-430d-909e-b1b8f07c5dab', '0914da45-ac28-47be-83df-8314d4deeef4', 'a3b192c7-9f53-4d33-99d5-8d16189cca9c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:23 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-31ec0b26-aecd-4d71-b05c-6a95ad8960c2 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-0f510ffa-19bc-4907-8317-9ecb28d9166e-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-01fda7ef-da28-4f58-b524-20604d63917b-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-01fda7ef-da28-4f58-b524-20604d63917b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-01fda7ef-da28-4f58-b524-20604d63917b" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-01fda7ef-da28-4f58-b524-20604d63917b" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0904bc38-a9a6-49ea-b43f-53ceb1ef5279]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b Sep 01 02:23:24 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b" returned: 0 in 0.339s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b Sep 01 02:23:24 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-01fda7ef-da28-4f58-b524-20604d63917b" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-01fda7ef-da28-4f58-b524-20604d63917b" released by "delete_volume" :: held 0.622s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['85ea5583-066f-45b7-bef4-cc72b2dcf01e', '8e2b16e0-ab15-47a3-bbc9-27ba490814db', 'dbb9d3db-888d-4920-bfe5-d340e3591fc5', '9ef75fc2-7a74-4330-bce0-d39adb681a6a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:24 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f57c8184-2cbe-45f7-b8e8-232327537d72 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-01fda7ef-da28-4f58-b524-20604d63917b-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[33517fe1-d921-47c1-8f07-58775198f183]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c Sep 01 02:23:25 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" returned: 0 in 0.341s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c Sep 01 02:23:25 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c" released by "delete_volume" :: held 0.606s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['5cceb600-7983-42a8-a05e-394c59da7a22', 'd269724b-64bd-4437-9943-66ea8ae35a27', 'da6cc85d-bb3c-4c5f-abca-8861bb25853e', 'd0d2639e-b225-463a-8284-b77a0d299668'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:26 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-65a36151-78d1-48ad-9e53-ff7480137364 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-97dce59d-58c7-4d8f-a2dd-0b0a27eb8d9c-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-8a8ee27d-6cd1-48e6-944c-2d972c911982-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-8a8ee27d-6cd1-48e6-944c-2d972c911982-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-8a8ee27d-6cd1-48e6-944c-2d972c911982" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-8a8ee27d-6cd1-48e6-944c-2d972c911982" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd43407-7339-4cc1-83c8-f12bba414943]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 Sep 01 02:23:26 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982 Sep 01 02:23:26 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-8a8ee27d-6cd1-48e6-944c-2d972c911982" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-8a8ee27d-6cd1-48e6-944c-2d972c911982" released by "delete_volume" :: held 0.603s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['8da7218a-6acd-49ee-ac2c-a228b87eaf3f', '50cdb7dd-e249-4bfe-8b5e-dfdfaedabd91', '67567e94-20c3-4139-86d2-41e6c8733734', '7058f803-0f5a-42cd-965d-198daf07f154'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:27 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-783effc3-7819-496e-b7bd-575c342215d7 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-8a8ee27d-6cd1-48e6-944c-2d972c911982-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-19565855-7294-4062-b97e-ad90ef17674a-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-19565855-7294-4062-b97e-ad90ef17674a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-19565855-7294-4062-b97e-ad90ef17674a" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-19565855-7294-4062-b97e-ad90ef17674a" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f24e2-4ed8-4e73-af99-ddd0189c55e8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a Sep 01 02:23:27 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a" returned: 0 in 0.333s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a Sep 01 02:23:28 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-19565855-7294-4062-b97e-ad90ef17674a" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-19565855-7294-4062-b97e-ad90ef17674a" released by "delete_volume" :: held 0.604s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['39665ced-8adb-447e-a9ef-64f456391b6f', 'bb073c5a-ab9c-417e-8077-4e116506c38b', 'c658f760-74e9-4bb0-a813-e98ed4759efc', 'd20be701-d0c7-47c5-82d5-96d6da155204'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:28 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.224s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-03b3a307-ccac-438c-ae71-fc44386b5ae3 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-19565855-7294-4062-b97e-ad90ef17674a-delete_volume" released by "delete_volume" :: held 1.009s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-a3c13f28-4f76-4e90-b5fb-058ac99f7482-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-a3c13f28-4f76-4e90-b5fb-058ac99f7482-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "cinder-quobyte-a3c13f28-4f76-4e90-b5fb-058ac99f7482" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-a3c13f28-4f76-4e90-b5fb-058ac99f7482" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6de05-60aa-41da-84ba-e3372252275f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 Sep 01 02:23:28 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482 Sep 01 02:23:29 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a3c13f28-4f76-4e90-b5fb-058ac99f7482" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-quobyte-a3c13f28-4f76-4e90-b5fb-058ac99f7482" released by "delete_volume" :: held 0.614s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Created reservations ['e015841c-eeed-4238-a20d-05addb3defaa', '9ceb81ba-dc45-444f-925a-b4314abe4c4b', '05c1186e-84f6-40f8-a627-29e6c71d0aad', 'fa79d7c0-20d3-4614-acf5-e6c27c04276e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:29 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Deleted volume successfully. Sep 01 02:23:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-034f4f59-92ac-4018-8894-34520daafb69 tempest-CreateVolumesFromSourceVolumeTest-1067705256 None] Lock "cinder-a3c13f28-4f76-4e90-b5fb-058ac99f7482-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Flow 'volume_create_manager' (303d0001-0bbd-4bc8-91b4-155f7905c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3679a5-0363-4c9f-8b18-f4cfd95831c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3679a5-0363-4c9f-8b18-f4cfd95831c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1158860343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae0964f-1c8c-4d4b-aedd-df9c27713642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb167c0ee6e49d4833d99a4cfb06a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:32Z,use_quota=True,user_id='07aba36f513a4b119375dd864b405d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3161c16c-3007-4ff1-b89b-add2a3d5f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3161c16c-3007-4ff1-b89b-add2a3d5f928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225de8bb-c445-4562-a1c2-507c7e5c61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225de8bb-c445-4562-a1c2-507c7e5c61ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae0964f-1c8c-4d4b-aedd-df9c27713642', 'volume_name': 'volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd5ee91-7ebd-4ad9-8d26-609cf05e7104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd5ee91-7ebd-4ad9-8d26-609cf05e7104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8fab7a-4056-4395-a0c5-fe7d902e7d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Volume 2ae0964f-1c8c-4d4b-aedd-df9c27713642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642', 'volume_size': 1} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1158860343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae0964f-1c8c-4d4b-aedd-df9c27713642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb167c0ee6e49d4833d99a4cfb06a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:32Z,use_quota=True,user_id='07aba36f513a4b119375dd864b405d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Creating volume 2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:32 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 1073741824 Sep 01 02:23:32 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 1073741824" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:32 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.227s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] <== create_volume: return (656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8fab7a-4056-4395-a0c5-fe7d902e7d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ec1e9-f119-4b8f-b034-a321088cb196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Volume volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 (2ae0964f-1c8c-4d4b-aedd-df9c27713642): created successfully Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ec1e9-f119-4b8f-b034-a321088cb196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Flow 'volume_create_manager' (303d0001-0bbd-4bc8-91b4-155f7905c437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-996245d6-716e-4ac9-aefc-2b30631d002a tempest-VolumeDependencyTests-897838657 None] Created volume successfully. Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Creating offline snapshot c566b051-e822-4015-92f8-da8dc7eec4a2 of volume 2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0414285-c8e9-4d00-a419-206684d6e07a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:33 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.333s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 1G Sep 01 02:23:34 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 1G" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:34 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 is being set with open permissions: ugo+rw Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:34 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.227s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info Sep 01 02:23:34 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info is being set with open permissions: ugo+rw Sep 01 02:23:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info Sep 01 02:23:35 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.info" returned: 0 in 0.226s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e4f3eccd-518c-4763-ab76-01f63b76331a tempest-VolumeDependencyTests-897838657 None] Create snapshot completed successfully Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Flow 'volume_create_manager' (b30a5600-3ee3-42ca-9c50-ca58d1a39125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f453f915-b10b-4709-8907-7ad1a953b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f453f915-b10b-4709-8907-7ad1a953b254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468529676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf04b7d-b962-4025-8769-044bbd57a757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb167c0ee6e49d4833d99a4cfb06a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c566b051-e822-4015-92f8-da8dc7eec4a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:36Z,use_quota=True,user_id='07aba36f513a4b119375dd864b405d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99f81a-d6b6-4503-988f-17b5daa4f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99f81a-d6b6-4503-988f-17b5daa4f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ffbf7f-3d4e-4d74-92be-2e848d814ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ffbf7f-3d4e-4d74-92be-2e848d814ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cf04b7d-b962-4025-8769-044bbd57a757', 'volume_name': 'volume-6cf04b7d-b962-4025-8769-044bbd57a757', 'volume_size': 1, 'snapshot_id': 'c566b051-e822-4015-92f8-da8dc7eec4a2'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec969168-0c5c-4767-9a06-fb1e1ceaa2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec969168-0c5c-4767-9a06-fb1e1ceaa2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace745b-0077-41aa-81fd-c55695591091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Volume 6cf04b7d-b962-4025-8769-044bbd57a757: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cf04b7d-b962-4025-8769-044bbd57a757', 'volume_size': 1, 'snapshot_id': 'c566b051-e822-4015-92f8-da8dc7eec4a2'} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2-6cf04b7d-b962-4025-8769-044bbd57a757" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2-6cf04b7d-b962-4025-8769-044bbd57a757" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Creating volume 6cf04b7d-b962-4025-8769-044bbd57a757 from snapshot c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] snapshot: c566b051-e822-4015-92f8-da8dc7eec4a2, volume: 6cf04b7d-b962-4025-8769-044bbd57a757, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b061c597-03ed-4d28-b544-c19e43663c10]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:36 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.332s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f8d2d-8682-43d7-82e0-7ec37fb99c87]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:36 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:37 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.335s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:23:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:23:37 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:23:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:37 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 Sep 01 02:23:37 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:40 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757" returned: 0 in 3.672s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642, size 1024.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:23:40 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Converted 1024.00 MB image at 278.75 MB/s Sep 01 02:23:40 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 is being set with open permissions: ugo+rw Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:40 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 Sep 01 02:23:40 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:40 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:40 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:40 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757" returned: 0 in 0.241s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" released by "_copy_volume_from_snapshot" :: held 4.651s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2-6cf04b7d-b962-4025-8769-044bbd57a757" released by "_create_volume_from_snapshot" :: held 4.708s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.726s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace745b-0077-41aa-81fd-c55695591091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf04b7d-b962-4025-8769-044bbd57a757', 'volume_size': 1, 'snapshot_id': 'c566b051-e822-4015-92f8-da8dc7eec4a2'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea24cc1-8688-42ee-854b-2a54e179a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Volume volume-6cf04b7d-b962-4025-8769-044bbd57a757 (6cf04b7d-b962-4025-8769-044bbd57a757): created successfully Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea24cc1-8688-42ee-854b-2a54e179a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Flow 'volume_create_manager' (b30a5600-3ee3-42ca-9c50-ca58d1a39125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-246578da-bc01-4755-a191-767ee1c85666 tempest-VolumeDependencyTests-897838657 None] Created volume successfully. Sep 01 02:23:41 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-c566b051-e822-4015-92f8-da8dc7eec4a2-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-c566b051-e822-4015-92f8-da8dc7eec4a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Deleting offline snapshot c566b051-e822-4015-92f8-da8dc7eec4a2 of volume 2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] snapshot_file for this snap is: volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd8d0b-ae23-4ddc-8f03-16266f22a968]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:41 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:41 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:42 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c3c53-a5c9-425a-b9bd-563741976cfe]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:42 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:42 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.493s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:42 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:42 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.309s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2 Sep 01 02:23:42 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:43 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642.c566b051-e822-4015-92f8-da8dc7eec4a2" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-c566b051-e822-4015-92f8-da8dc7eec4a2" released by "_delete_snapshot" :: held 1.482s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" released by "delete_snapshot" :: held 1.503s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Created reservations ['66e575b9-478e-471a-aab9-9a05d285b471', '10744c75-0215-4ce6-8aa0-d9447090429b', 'ae011b64-9dec-47ae-92b5-8d61377e5f81', '97805679-c8b1-46d1-8b31-bd624ea90f0a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Delete snapshot completed successfully. Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-15baa7a8-e809-4753-9fd0-b302d7c45861 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-c566b051-e822-4015-92f8-da8dc7eec4a2-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-2ae0964f-1c8c-4d4b-aedd-df9c27713642-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-2ae0964f-1c8c-4d4b-aedd-df9c27713642-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55021d2-8e65-4df3-9f8e-d7024b29933b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:44 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642 Sep 01 02:23:44 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2ae0964f-1c8c-4d4b-aedd-df9c27713642" returned: 0 in 0.237s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-2ae0964f-1c8c-4d4b-aedd-df9c27713642" released by "delete_volume" :: held 0.641s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Created reservations ['8cda3275-216b-4b50-b352-64c5cb7e0391', '04ce667e-c46b-47d0-8c87-c1331f7c58f2', '2dd635c2-f11b-4b93-ab1b-f07b4921d2ce', '4b221aaf-1a4e-487a-a328-e61cae403947'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:44 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Deleted volume successfully. Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d5d2a3c8-8bce-4836-9d98-bb3c11bb6478 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-2ae0964f-1c8c-4d4b-aedd-df9c27713642-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-6cf04b7d-b962-4025-8769-044bbd57a757-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-6cf04b7d-b962-4025-8769-044bbd57a757-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdcdb94-cb1b-43d9-813e-40aae64bcf1d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 Sep 01 02:23:45 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757" returned: 0 in 0.347s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757 Sep 01 02:23:45 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6cf04b7d-b962-4025-8769-044bbd57a757" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-quobyte-6cf04b7d-b962-4025-8769-044bbd57a757" released by "delete_volume" :: held 0.617s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Created reservations ['22bc0217-5a3e-4541-864a-7e4e2860359f', '1211b2a5-5317-40c8-bec9-dfd939880c9d', '536aa41a-091c-48d1-8f98-084686fc0ddf', 'ad49cd5e-d650-4d13-98c5-da5b72439646'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:45 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Deleted volume successfully. Sep 01 02:23:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c5a94c79-69c4-4702-a0cb-05451404fd89 tempest-VolumeDependencyTests-897838657 None] Lock "cinder-6cf04b7d-b962-4025-8769-044bbd57a757-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Flow 'volume_create_manager' (66688c9b-0ec0-4ac5-aa06-6c6c52765d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c881e2e-471e-46e9-a345-69bcbc92fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c881e2e-471e-46e9-a345-69bcbc92fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fceaa87-31dc-4bfd-b490-58bf7d5f84c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32639579d5134ad5aaf80fbbe6ca7229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:49Z,use_quota=True,user_id='afcefa59075b454c9f883c95617325d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84135785-55eb-4309-b6b2-07dffd609392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84135785-55eb-4309-b6b2-07dffd609392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da84064-4341-4f3d-ad5b-d39d6a44d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da84064-4341-4f3d-ad5b-d39d6a44d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fceaa87-31dc-4bfd-b490-58bf7d5f84c0', 'volume_name': 'volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a42f66-21a8-4913-83cd-d4fb8fa71baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a42f66-21a8-4913-83cd-d4fb8fa71baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d4c2a-88d0-4377-a470-c55e25d361de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Volume 7fceaa87-31dc-4bfd-b490-58bf7d5f84c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0', 'volume_size': 1} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fceaa87-31dc-4bfd-b490-58bf7d5f84c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32639579d5134ad5aaf80fbbe6ca7229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:49Z,use_quota=True,user_id='afcefa59075b454c9f883c95617325d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Creating volume 7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:48 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 1073741824 Sep 01 02:23:48 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 1073741824" returned: 0 in 0.380s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 Sep 01 02:23:49 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d4c2a-88d0-4377-a470-c55e25d361de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06156fb9-9631-442b-bbe1-aa7ec23740fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:49 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Volume volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 (7fceaa87-31dc-4bfd-b490-58bf7d5f84c0): created successfully Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06156fb9-9631-442b-bbe1-aa7ec23740fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Flow 'volume_create_manager' (66688c9b-0ec0-4ac5-aa06-6c6c52765d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fa2456d4-3b98-43bb-b623-d5f03ebb542b tempest-CinderUnicodeTest-1585103834 None] Created volume successfully. Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Flow 'volume_create_manager' (817582d6-57b8-4d33-adb4-c3215059fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df34adb-de24-4fe6-a6d1-ac53368547d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df34adb-de24-4fe6-a6d1-ac53368547d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1553391353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f6529e-5128-4400-a509-65160540d882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32639579d5134ad5aaf80fbbe6ca7229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:50Z,use_quota=True,user_id='afcefa59075b454c9f883c95617325d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f1b720-812d-43c7-a098-15e1cc1cd9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f1b720-812d-43c7-a098-15e1cc1cd9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4639f1d6-dc70-4981-ab70-1ddb51138b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4639f1d6-dc70-4981-ab70-1ddb51138b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f6529e-5128-4400-a509-65160540d882', 'volume_name': 'volume-d8f6529e-5128-4400-a509-65160540d882', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e49a92-f0f8-4e5c-8eb8-08987c582449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e49a92-f0f8-4e5c-8eb8-08987c582449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b65b17d-73be-4cb5-9098-21bcffb96db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Volume d8f6529e-5128-4400-a509-65160540d882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f6529e-5128-4400-a509-65160540d882', 'volume_size': 1} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1553391353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f6529e-5128-4400-a509-65160540d882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32639579d5134ad5aaf80fbbe6ca7229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:50Z,use_quota=True,user_id='afcefa59075b454c9f883c95617325d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Creating volume d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:50 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 1073741824 Sep 01 02:23:50 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 1073741824" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 Sep 01 02:23:50 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b65b17d-73be-4cb5-9098-21bcffb96db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f6529e-5128-4400-a509-65160540d882', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df572fe-b0b5-4085-b8f5-3f1c7bf3b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Volume volume-d8f6529e-5128-4400-a509-65160540d882 (d8f6529e-5128-4400-a509-65160540d882): created successfully Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df572fe-b0b5-4085-b8f5-3f1c7bf3b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Flow 'volume_create_manager' (817582d6-57b8-4d33-adb4-c3215059fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f2b7bdc9-93e9-4b40-85a2-6bc48dc9e010 tempest-CinderUnicodeTest-1585103834 None] Created volume successfully. Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Creating offline snapshot 1c0c02cc-f87f-4d34-b516-abdc7ce1c275 of volume d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d7a93-1603-46d0-b655-d0b8ea9285af]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 Sep 01 02:23:51 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 1G Sep 01 02:23:51 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 1G" returned: 0 in 0.376s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f6529e-5128-4400-a509-65160540d882 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f6529e-5128-4400-a509-65160540d882 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 Sep 01 02:23:52 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f6529e-5128-4400-a509-65160540d882 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275" returned: 0 in 0.295s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 is being set with open permissions: ugo+rw Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 Sep 01 02:23:52 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info Sep 01 02:23:52 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info is being set with open permissions: ugo+rw Sep 01 02:23:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info Sep 01 02:23:52 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.info" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8799f09f-1c0f-488d-93ec-c0246e280219 tempest-CinderUnicodeTest-1585103834 None] Create snapshot completed successfully Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-1c0c02cc-f87f-4d34-b516-abdc7ce1c275-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-1c0c02cc-f87f-4d34-b516-abdc7ce1c275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-quobyte-1c0c02cc-f87f-4d34-b516-abdc7ce1c275" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-1c0c02cc-f87f-4d34-b516-abdc7ce1c275" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Deleting offline snapshot 1c0c02cc-f87f-4d34-b516-abdc7ce1c275 of volume d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] snapshot_file for this snap is: volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bddd705-694f-488f-8733-abdea669f8b5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 Sep 01 02:23:53 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275" returned: 0 in 0.331s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f6529e-5128-4400-a509-65160540d882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ea001-100b-43cc-aa5e-ba437fe48946]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 Sep 01 02:23:54 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882" returned: 0 in 0.333s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 Sep 01 02:23:54 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275" returned: 0 in 0.314s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275 Sep 01 02:23:54 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882.1c0c02cc-f87f-4d34-b516-abdc7ce1c275" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-1c0c02cc-f87f-4d34-b516-abdc7ce1c275" released by "_delete_snapshot" :: held 1.322s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" released by "delete_snapshot" :: held 1.343s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Created reservations ['c174577c-8690-4831-a1ee-0e08f3eac32c', '93e30fbb-8d4c-4035-89a5-193f992b6043', '7df0d48e-51ef-41ca-927b-bbaf2873c301', 'ebbbd3e8-1ddb-4546-ad67-a9ef6fc539e1'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Delete snapshot completed successfully. Sep 01 02:23:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ccb7fb78-d154-49fb-9142-f56b03192929 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-1c0c02cc-f87f-4d34-b516-abdc7ce1c275-delete_snapshot" released by "delete_snapshot" :: held 1.459s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-d8f6529e-5128-4400-a509-65160540d882-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-d8f6529e-5128-4400-a509-65160540d882-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" acquired by "delete_volume" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fcfbeb-14a6-413d-9634-8171f9dc9ad5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:55 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 Sep 01 02:23:55 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882" returned: 0 in 0.354s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882 Sep 01 02:23:56 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-d8f6529e-5128-4400-a509-65160540d882" returned: 0 in 0.229s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-d8f6529e-5128-4400-a509-65160540d882" released by "delete_volume" :: held 0.637s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Created reservations ['0104134b-f001-4247-b493-9e409a2c79f2', '36435d18-c022-460e-9807-c8f0503e4af4', '6bbd33d5-8162-4cbd-9987-0645f6cf14af', '1d197da6-aa8b-4987-9456-b9681cc944c4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:56 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:56 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Deleted volume successfully. Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17f2466b-6661-424c-93d4-4c14a1f466c9 tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-d8f6529e-5128-4400-a509-65160540d882-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "cinder-quobyte-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efb9cd9-a851-446c-892e-d997eac24c41]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 Sep 01 02:23:57 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" returned: 0 in 0.349s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0 Sep 01 02:23:57 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-quobyte-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0" released by "delete_volume" :: held 0.616s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Created reservations ['b0a3ce96-af86-4ce0-a784-250271e57c0e', 'd50d8822-0111-4946-945c-79f90b8f71bb', 'e1304684-b661-4203-9c03-e611f4ad33fb', 'cc02fbbe-6173-4242-aad7-0eb30cc78523'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:23:57 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.240s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Deleted volume successfully. Sep 01 02:23:57 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7ea46206-843f-4ced-8807-3f98c2d23fad tempest-CinderUnicodeTest-1585103834 None] Lock "cinder-7fceaa87-31dc-4bfd-b490-58bf7d5f84c0-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:07 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=139,cinder:UPDATE=167,cinder:INSERT=43,cinder:DELETE=16 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:24:07 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=110,cinder:UPDATE=191,cinder:DELETE=16,cinder:INSERT=42 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (4ce1f1d2-9d6e-4ee9-969c-4c026126363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271657e-aead-451e-999a-bfb6c4906769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271657e-aead-451e-999a-bfb6c4906769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087271192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6537b595-be29-46f9-bb16-d0a450659c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5d913b-3f36-4396-a3f8-5c9a40643439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5d913b-3f36-4396-a3f8-5c9a40643439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25feaf2-8754-4768-aea9-22884feb39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25feaf2-8754-4768-aea9-22884feb39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6537b595-be29-46f9-bb16-d0a450659c27', 'volume_name': 'volume-6537b595-be29-46f9-bb16-d0a450659c27', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8169a9fa-9754-4e49-b856-37de1167269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8169a9fa-9754-4e49-b856-37de1167269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8e0c7c-2f61-4fb9-9dfd-00fab1b4f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume 6537b595-be29-46f9-bb16-d0a450659c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6537b595-be29-46f9-bb16-d0a450659c27', 'volume_size': 1} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087271192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6537b595-be29-46f9-bb16-d0a450659c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume 6537b595-be29-46f9-bb16-d0a450659c27 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:10 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:10 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 1073741824 Sep 01 02:24:10 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (4553500f-0b2f-40d5-8596-47dc649cb114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53252d27-001e-402e-93ef-0c6c8c356987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53252d27-001e-402e-93ef-0c6c8c356987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730044163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb373a8f-fba2-415b-a0d9-4feedf98f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b45be4-1fb0-4be1-b98b-2097a0f38486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b45be4-1fb0-4be1-b98b-2097a0f38486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aab304b-8369-479b-a43a-e3c33584a45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aab304b-8369-479b-a43a-e3c33584a45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb373a8f-fba2-415b-a0d9-4feedf98f482', 'volume_name': 'volume-eb373a8f-fba2-415b-a0d9-4feedf98f482', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa1301a-2c83-403c-abbf-9fc57100049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa1301a-2c83-403c-abbf-9fc57100049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c458e32-8934-4125-8069-0b97832f100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Volume eb373a8f-fba2-415b-a0d9-4feedf98f482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb373a8f-fba2-415b-a0d9-4feedf98f482', 'volume_size': 1} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (8c640f6f-dc74-4639-a6d8-fd08ccce56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ae3a9-21f3-4471-acb2-c1afb6943ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ae3a9-21f3-4471-acb2-c1afb6943ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928688765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c238800-6dda-47a4-9fab-21aa3c6c18d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed2901e-0ec5-4660-ab27-6b91636cf584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed2901e-0ec5-4660-ab27-6b91636cf584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d07190b-e5d5-48fb-9b35-81141a390d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d07190b-e5d5-48fb-9b35-81141a390d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c238800-6dda-47a4-9fab-21aa3c6c18d0', 'volume_name': 'volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed585d80-53f5-40b3-aced-ec0c63f6c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed585d80-53f5-40b3-aced-ec0c63f6c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0ef84f-d5f1-4a67-9b31-75d641ac944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Volume 1c238800-6dda-47a4-9fab-21aa3c6c18d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0', 'volume_size': 1} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:10 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 1073741824" returned: 0 in 0.614s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 Sep 01 02:24:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (d907bfb3-c3e0-4eb0-9530-ba2f622b4fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d5532-5b67-4f57-aa24-c84c5b58cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d5532-5b67-4f57-aa24-c84c5b58cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1954284145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4000c371-2c3f-4303-a7c5-7b72ec76a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9854f693-f73f-42d8-90f2-ea24ad4dd9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9854f693-f73f-42d8-90f2-ea24ad4dd9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05362734-4db6-4cf8-8be2-1d6e0ce0e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05362734-4db6-4cf8-8be2-1d6e0ce0e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4000c371-2c3f-4303-a7c5-7b72ec76a09a', 'volume_name': 'volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c61aa4-aa24-4736-ac78-1ac97bacddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c61aa4-aa24-4736-ac78-1ac97bacddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15339519-3ca8-4662-a15f-8956ee0e20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume 4000c371-2c3f-4303-a7c5-7b72ec76a09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a', 'volume_size': 1} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (bd54eb17-533b-406b-a5bc-a96ad43ed983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724cd40f-0d3a-43f2-8ee6-b4883a54370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724cd40f-0d3a-43f2-8ee6-b4883a54370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354382707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20811534-75dd-4224-ab74-4fdf3657fcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc294573-88be-42e8-8deb-166a9ca941e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc294573-88be-42e8-8deb-166a9ca941e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f698ddf7-a679-49b0-b681-d331ee45773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f698ddf7-a679-49b0-b681-d331ee45773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20811534-75dd-4224-ab74-4fdf3657fcd8', 'volume_name': 'volume-20811534-75dd-4224-ab74-4fdf3657fcd8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5360baed-3747-4d6b-8283-2b3786aaa2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5360baed-3747-4d6b-8283-2b3786aaa2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76585c2-35a9-4311-b493-a324854f5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Volume 20811534-75dd-4224-ab74-4fdf3657fcd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20811534-75dd-4224-ab74-4fdf3657fcd8', 'volume_size': 1} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27" returned: 0 in 0.411s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730044163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb373a8f-fba2-415b-a0d9-4feedf98f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Creating volume eb373a8f-fba2-415b-a0d9-4feedf98f482 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8e0c7c-2f61-4fb9-9dfd-00fab1b4f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6537b595-be29-46f9-bb16-d0a450659c27', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 1073741824 Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b18e37-0e9b-4e64-8533-b1b567143e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-6537b595-be29-46f9-bb16-d0a450659c27 (6537b595-be29-46f9-bb16-d0a450659c27): created successfully Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b18e37-0e9b-4e64-8533-b1b567143e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (4ce1f1d2-9d6e-4ee9-969c-4c026126363c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (9131fe43-7426-4f64-9099-058e73daba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025e0063-07c1-42bf-a31d-674f39cdc83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4f21f0b8-5926-49b6-ac8d-33797d15a286 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025e0063-07c1-42bf-a31d-674f39cdc83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318626215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73950a9a-1cb8-4905-bc76-da131fb838cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f446979-3f9a-4a21-b717-3f246e2078e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f446979-3f9a-4a21-b717-3f246e2078e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2164f1e9-c90e-429f-bce3-6350b7c82e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2164f1e9-c90e-429f-bce3-6350b7c82e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73950a9a-1cb8-4905-bc76-da131fb838cb', 'volume_name': 'volume-73950a9a-1cb8-4905-bc76-da131fb838cb', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be5598e-5fb5-4909-8717-b3d6db842a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be5598e-5fb5-4909-8717-b3d6db842a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766fcf2d-d8ae-485f-a16c-af312d918ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Volume 73950a9a-1cb8-4905-bc76-da131fb838cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73950a9a-1cb8-4905-bc76-da131fb838cb', 'volume_size': 1} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (e3f593b5-de3e-44b8-a608-41dde45c0cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112858f0-f6d4-4a9d-ba30-c96b3a43aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112858f0-f6d4-4a9d-ba30-c96b3a43aad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167583563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc70f42b-1ca6-4c60-bd19-7f60d25dc90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:12Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad1762-726e-44ce-a715-d425b0141032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad1762-726e-44ce-a715-d425b0141032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216b67f1-3ee7-4ff1-aec4-af2b415fde3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216b67f1-3ee7-4ff1-aec4-af2b415fde3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc70f42b-1ca6-4c60-bd19-7f60d25dc90f', 'volume_name': 'volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36c16a8-1b05-495c-adb0-ccc817f4bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36c16a8-1b05-495c-adb0-ccc817f4bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89657c24-43b4-418f-9f0b-090a2be167be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Volume bc70f42b-1ca6-4c60-bd19-7f60d25dc90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f', 'volume_size': 1} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 1073741824" returned: 0 in 0.589s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:12 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 Sep 01 02:24:12 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:12 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482" returned: 0 in 0.298s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928688765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c238800-6dda-47a4-9fab-21aa3c6c18d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:10Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Creating volume 1c238800-6dda-47a4-9fab-21aa3c6c18d0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:12 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c458e32-8934-4125-8069-0b97832f100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb373a8f-fba2-415b-a0d9-4feedf98f482', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb08ec-fa00-4429-beab-88c9ad0d426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 1073741824 Sep 01 02:24:12 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Volume volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 (eb373a8f-fba2-415b-a0d9-4feedf98f482): created successfully Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb08ec-fa00-4429-beab-88c9ad0d426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (4553500f-0b2f-40d5-8596-47dc649cb114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-aef5d2ad-fc05-4451-8c43-d3b4b7c4884b tempest-CreateVolumesFromImageTest-1822878228 None] Created volume successfully. Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (ff9d8bc2-621c-4ec0-a7f8-2e14606002a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e95acf-ed8b-45e0-b0e2-7bdfaafd1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e95acf-ed8b-45e0-b0e2-7bdfaafd1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700496211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477bbb8-85de-47ee-964b-88c8ed2c790d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f97e6f-450b-4a9e-91cd-bb0302876fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f97e6f-450b-4a9e-91cd-bb0302876fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd31e32b-f5d8-4932-bfc4-7621e050bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd31e32b-f5d8-4932-bfc4-7621e050bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c477bbb8-85de-47ee-964b-88c8ed2c790d', 'volume_name': 'volume-c477bbb8-85de-47ee-964b-88c8ed2c790d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e173c9-1e64-4dff-b78d-2d3df48529d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e173c9-1e64-4dff-b78d-2d3df48529d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4532f23-fb76-4f6b-b082-0924b4ede108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume c477bbb8-85de-47ee-964b-88c8ed2c790d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c477bbb8-85de-47ee-964b-88c8ed2c790d', 'volume_size': 1} Sep 01 02:24:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:13 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 1073741824" returned: 0 in 0.654s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:13 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 Sep 01 02:24:13 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (237e1c61-9589-4d52-80f8-df2e54c090e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d378ed3-25da-4bcf-983f-bcbbdda96dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d378ed3-25da-4bcf-983f-bcbbdda96dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302740499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551f7740-6bde-4916-b77f-9d946ecc7ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f5717a-5ea5-487d-9939-5dbbe615e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f5717a-5ea5-487d-9939-5dbbe615e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427bc51-3412-4ee7-984a-a4a2e281fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427bc51-3412-4ee7-984a-a4a2e281fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551f7740-6bde-4916-b77f-9d946ecc7ca9', 'volume_name': 'volume-551f7740-6bde-4916-b77f-9d946ecc7ca9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cd451-45cd-4ff7-b6db-4217c9a32ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cd451-45cd-4ff7-b6db-4217c9a32ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49bacf6-7adb-4ef5-a6af-7d3a3f2f3187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume 551f7740-6bde-4916-b77f-9d946ecc7ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551f7740-6bde-4916-b77f-9d946ecc7ca9', 'volume_size': 1} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:13 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1954284145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4000c371-2c3f-4303-a7c5-7b72ec76a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume 4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:13 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a 1073741824 Sep 01 02:24:13 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0ef84f-d5f1-4a67-9b31-75d641ac944a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f41d156-1e68-476a-899c-ccb57b02323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Volume volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 (1c238800-6dda-47a4-9fab-21aa3c6c18d0): created successfully Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f41d156-1e68-476a-899c-ccb57b02323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (8c640f6f-dc74-4639-a6d8-fd08ccce56ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-07683a3f-44a7-4428-8289-7e29c3607785 tempest-CreateVolumesFromImageTest-1822878228 None] Created volume successfully. Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (084cb4c2-973e-404d-bb51-db16f7f007ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f2925e-098a-4963-b65a-3ff27eb6e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f2925e-098a-4963-b65a-3ff27eb6e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1326892768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc2875-5782-4abf-be90-9f27fcdcf315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc2875-5782-4abf-be90-9f27fcdcf315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624900b4-5039-4077-ba6f-1280635512a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624900b4-5039-4077-ba6f-1280635512a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce', 'volume_name': 'volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367e4b50-397b-4f04-aa5a-7944e3d98a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367e4b50-397b-4f04-aa5a-7944e3d98a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a5dd87-fa2c-44b5-a49f-846a58289651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce', 'volume_size': 1} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (ee1c41af-a2b8-49b8-83c2-fa488a74bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a7f7fc-395f-4d46-a871-f5bab303d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a7f7fc-395f-4d46-a871-f5bab303d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764425307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2c6879-f664-4774-81c2-84ebeb8803c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d0ffb0-8fd0-4db4-b84b-87b0f47f7e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d0ffb0-8fd0-4db4-b84b-87b0f47f7e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c01069-1b3e-40cd-912b-26a75b4aabae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c01069-1b3e-40cd-912b-26a75b4aabae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2c6879-f664-4774-81c2-84ebeb8803c7', 'volume_name': 'volume-1f2c6879-f664-4774-81c2-84ebeb8803c7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca51517-607e-4c45-9fb2-2c17c339feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca51517-607e-4c45-9fb2-2c17c339feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8257854d-3c7f-40d1-855c-6ff0c8f3805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume 1f2c6879-f664-4774-81c2-84ebeb8803c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2c6879-f664-4774-81c2-84ebeb8803c7', 'volume_size': 1} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a 1073741824" returned: 0 in 0.672s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:14 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a Sep 01 02:24:14 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (48993d3d-1e26-4d35-8071-e641c5230476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f96e0c-5c77-44c4-bd10-867e5da8a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354382707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20811534-75dd-4224-ab74-4fdf3657fcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Creating volume 20811534-75dd-4224-ab74-4fdf3657fcd8 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:14 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f96e0c-5c77-44c4-bd10-867e5da8a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42652836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f2c7ae-e131-4edf-abce-b32e673521cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 1073741824 Sep 01 02:24:14 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660c3e41-efc0-4d09-8ebb-7f16a29284e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660c3e41-efc0-4d09-8ebb-7f16a29284e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8de77d-5b96-4916-be32-c49c5d315f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8de77d-5b96-4916-be32-c49c5d315f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f2c7ae-e131-4edf-abce-b32e673521cc', 'volume_name': 'volume-57f2c7ae-e131-4edf-abce-b32e673521cc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59db835-2eb1-4525-8f2d-9da329cd391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59db835-2eb1-4525-8f2d-9da329cd391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abbdf8f-a592-4480-bbe7-9f84432a86fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume 57f2c7ae-e131-4edf-abce-b32e673521cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f2c7ae-e131-4edf-abce-b32e673521cc', 'volume_size': 1} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15339519-3ca8-4662-a15f-8956ee0e20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328644d0-6e99-4158-bb01-d986c0c8096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a (4000c371-2c3f-4303-a7c5-7b72ec76a09a): created successfully Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328644d0-6e99-4158-bb01-d986c0c8096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (d907bfb3-c3e0-4eb0-9530-ba2f622b4fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-442a01fe-4863-44f3-b9f3-543fcc1e974a tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:14 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 1073741824" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:14 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 Sep 01 02:24:14 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Flow 'volume_create_manager' (22a36579-9e37-4ed8-b952-4aca1c6f4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72deb651-1024-445c-96af-cab3a6a020e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72deb651-1024-445c-96af-cab3a6a020e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713d89f8-4798-4325-b73d-202b09890136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d3fc3f00fd4947888d842e95b2fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:15Z,use_quota=True,user_id='791a3262bfca41458ef2c6af07a23434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4ec5f8-4e43-4724-9bef-ae6c6cb9113d),volume_type_id=0e4ec5f8-4e43-4724-9bef-ae6c6cb9113d)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bca10d-5c0a-477a-8748-fed31a9f970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bca10d-5c0a-477a-8748-fed31a9f970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ff780-d519-4f20-b94b-d23bd509eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:24:15 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8" returned: 0 in 0.263s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.538s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318626215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73950a9a-1cb8-4905-bc76-da131fb838cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:11Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Creating volume 73950a9a-1cb8-4905-bc76-da131fb838cb {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76585c2-35a9-4311-b493-a324854f5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20811534-75dd-4224-ab74-4fdf3657fcd8', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167c4842-5b21-4518-99ea-438fde523301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:15 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb 1073741824 Sep 01 02:24:15 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Volume volume-20811534-75dd-4224-ab74-4fdf3657fcd8 (20811534-75dd-4224-ab74-4fdf3657fcd8): created successfully Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167c4842-5b21-4518-99ea-438fde523301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (bd54eb17-533b-406b-a5bc-a96ad43ed983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4b7a8df9-b6fb-454b-bc54-c6ccc7285b6b tempest-CreateVolumesFromImageTest-1822878228 None] Created volume successfully. Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ff780-d519-4f20-b94b-d23bd509eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '713d89f8-4798-4325-b73d-202b09890136', 'volume_name': 'volume-713d89f8-4798-4325-b73d-202b09890136', 'volume_size': 1, 'image_id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f7cbdfbf09ea83de3a2623bd644d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d3fc3f00fd4947888d842e95b2fec1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4535115f4bc7ba93b26b676483895486135dec6d97305f06bcd9c0a48090958f4357d93e6662c43b7309fa1fd1ee47296c63071cb6862c8e9e6f1ec26b5c1658', 'id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6831fd7e-fe49-4fa4-90b4-453908945417/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fff5329-c752-4aa9-84af-684bccf34a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fff5329-c752-4aa9-84af-684bccf34a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750e8aaf-5bc2-4527-90a2-637aefe02069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Volume 713d89f8-4798-4325-b73d-202b09890136: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-713d89f8-4798-4325-b73d-202b09890136', 'volume_size': 1, 'image_id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f7cbdfbf09ea83de3a2623bd644d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d3fc3f00fd4947888d842e95b2fec1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4535115f4bc7ba93b26b676483895486135dec6d97305f06bcd9c0a48090958f4357d93e6662c43b7309fa1fd1ee47296c63071cb6862c8e9e6f1ec26b5c1658', 'id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6831fd7e-fe49-4fa4-90b4-453908945417/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Trying to clone 713d89f8-4798-4325-b73d-202b09890136 from image 6831fd7e-fe49-4fa4-90b4-453908945417 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ae8e6-798e-44a4-88f5-bb1db0eaf141]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb 1073741824" returned: 0 in 0.485s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:15 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:15 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb Sep 01 02:24:15 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb" returned: 0 in 0.265s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.944s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167583563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc70f42b-1ca6-4c60-bd19-7f60d25dc90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6cb017db0e42de8a32c7dba01924b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:12Z,use_quota=True,user_id='91c1c5dadd744cdfac2a2eac49f632aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Creating volume bc70f42b-1ca6-4c60-bd19-7f60d25dc90f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:15 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f 1073741824 Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766fcf2d-d8ae-485f-a16c-af312d918ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73950a9a-1cb8-4905-bc76-da131fb838cb', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed04f6ad-ea33-4c71-ac5b-535cfdcde16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Volume volume-73950a9a-1cb8-4905-bc76-da131fb838cb (73950a9a-1cb8-4905-bc76-da131fb838cb): created successfully Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed04f6ad-ea33-4c71-ac5b-535cfdcde16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (9131fe43-7426-4f64-9099-058e73daba06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e380a30f-c8ab-47da-85cd-9eb5497d9ac9 tempest-CreateVolumesFromImageTest-1822878228 None] Created volume successfully. Sep 01 02:24:16 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Temporary image 6831fd7e-fe49-4fa4-90b4-453908945417 is fetched for user 791a3262bfca41458ef2c6af07a23434. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981c4db-c656-43be-897a-4ff15278c0e8]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:16 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f 1073741824" returned: 0 in 0.513s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f Sep 01 02:24:16 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.974s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700496211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477bbb8-85de-47ee-964b-88c8ed2c790d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume c477bbb8-85de-47ee-964b-88c8ed2c790d {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:16 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:16 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d 1073741824 Sep 01 02:24:16 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89657c24-43b4-418f-9f0b-090a2be167be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d414ff1-6ba3-4fe5-b787-6dae3243fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:16 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Volume volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f (bc70f42b-1ca6-4c60-bd19-7f60d25dc90f): created successfully Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d414ff1-6ba3-4fe5-b787-6dae3243fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Flow 'volume_create_manager' (e3f593b5-de3e-44b8-a608-41dde45c0cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c7612f65-4134-495a-bddd-38da3ee1dc35 tempest-CreateVolumesFromImageTest-1822878228 None] Created volume successfully. Sep 01 02:24:17 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:17 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d 1073741824" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d Sep 01 02:24:17 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.254s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302740499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551f7740-6bde-4916-b77f-9d946ecc7ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume 551f7740-6bde-4916-b77f-9d946ecc7ca9 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:17 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4532f23-fb76-4f6b-b082-0924b4ede108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c477bbb8-85de-47ee-964b-88c8ed2c790d', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:17 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 1073741824 Sep 01 02:24:17 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9685993a-379b-4e0b-a3e8-317261c76582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-c477bbb8-85de-47ee-964b-88c8ed2c790d (c477bbb8-85de-47ee-964b-88c8ed2c790d): created successfully Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9685993a-379b-4e0b-a3e8-317261c76582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (ff9d8bc2-621c-4ec0-a7f8-2e14606002a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7d072dc3-e073-4ea4-9c9f-2a1a06ac3858 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-quobyte-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1690c2-db02-47ff-958a-a1d634592af3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f Sep 01 02:24:17 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 1073741824" returned: 0 in 0.428s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 Sep 01 02:24:17 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" returned: 0 in 0.374s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f Sep 01 02:24:18 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.646s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1326892768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:13Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:18 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49bacf6-7adb-4ef5-a6af-7d3a3f2f3187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551f7740-6bde-4916-b77f-9d946ecc7ca9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce 1073741824 Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee15023-801c-4fe1-ba21-c19104ba8280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 (551f7740-6bde-4916-b77f-9d946ecc7ca9): created successfully Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee15023-801c-4fe1-ba21-c19104ba8280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (237e1c61-9589-4d52-80f8-df2e54c090e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f0f0a410-3d74-4e18-b776-67740389dd5c tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:18 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f" released by "delete_volume" :: held 0.661s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Created reservations ['f07481d6-9e0c-4439-95f5-4dfc5683a568', '139692f0-6778-4465-bae6-20d0a7b54923', 'c4bd3472-5f97-4ab2-b62f-f965f2e3f535', 'ce9a227e-0aad-4103-a0cb-c6ac0f7f3f5f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:18 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:18 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Deleted volume successfully. Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-29b8058f-4b41-445b-93d1-4c662585a5f6 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-bc70f42b-1ca6-4c60-bd19-7f60d25dc90f-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:18 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce 1073741824" returned: 0 in 0.516s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-73950a9a-1cb8-4905-bc76-da131fb838cb-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-73950a9a-1cb8-4905-bc76-da131fb838cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:18 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce Sep 01 02:24:18 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-quobyte-73950a9a-1cb8-4905-bc76-da131fb838cb" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-73950a9a-1cb8-4905-bc76-da131fb838cb" acquired by "delete_volume" :: waited 0.024s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1fdaf-8233-4aa7-b77a-a002cabd39ad]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb Sep 01 02:24:19 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" returned: 0 in 0.263s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.022s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764425307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2c6879-f664-4774-81c2-84ebeb8803c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume 1f2c6879-f664-4774-81c2-84ebeb8803c7 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a5dd87-fa2c-44b5-a49f-846a58289651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4569f17-60d5-4088-896b-84966ca83012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:19 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 1073741824 Sep 01 02:24:19 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce (adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce): created successfully Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4569f17-60d5-4088-896b-84966ca83012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (084cb4c2-973e-404d-bb51-db16f7f007ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9dde41ba-70ab-4366-a45d-86c830b27b44 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:19 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb Sep 01 02:24:19 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-73950a9a-1cb8-4905-bc76-da131fb838cb" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 1073741824" returned: 0 in 0.433s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-73950a9a-1cb8-4905-bc76-da131fb838cb" released by "delete_volume" :: held 0.644s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 Sep 01 02:24:19 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Created reservations ['22fdea5c-1916-49ab-a5f6-ba18022d5056', 'ea799faa-2044-4c7c-a070-42a78231ddbb', '6824690a-1857-463e-90fd-58937b65ece4', '30c8ad2e-408f-43b6-a6ed-339b2dabec20'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:19 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42652836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f2c7ae-e131-4edf-abce-b32e673521cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5f054775c4088b695f416cef0ceb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='f60aebcb0b074cb4a55c86397530b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Creating volume 57f2c7ae-e131-4edf-abce-b32e673521cc {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8257854d-3c7f-40d1-855c-6ff0c8f3805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2c6879-f664-4774-81c2-84ebeb8803c7', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc 1073741824 Sep 01 02:24:19 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ce9aa1-02ad-4ffb-b5ae-c00125b5beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 (1f2c6879-f664-4774-81c2-84ebeb8803c7): created successfully Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ce9aa1-02ad-4ffb-b5ae-c00125b5beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (ee1c41af-a2b8-49b8-83c2-fa488a74bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a321e7a1-d57d-476a-a8fa-bcabe9c96ee9 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:19 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Deleted volume successfully. Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-11a81fa4-7ce1-4638-9932-19b333c9a9f4 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-73950a9a-1cb8-4905-bc76-da131fb838cb-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-20811534-75dd-4224-ab74-4fdf3657fcd8-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-20811534-75dd-4224-ab74-4fdf3657fcd8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-quobyte-20811534-75dd-4224-ab74-4fdf3657fcd8" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-20811534-75dd-4224-ab74-4fdf3657fcd8" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce476d-0257-4703-8a27-c14027599df0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 Sep 01 02:24:20 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc 1073741824" returned: 0 in 0.437s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc Sep 01 02:24:20 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8" returned: 0 in 0.360s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8 Sep 01 02:24:20 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.176s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abbdf8f-a592-4480-bbe7-9f84432a86fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f2c7ae-e131-4edf-abce-b32e673521cc', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffddb471-fdd2-4d44-87aa-b7312e3e396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating offline snapshot e700e5bb-b95d-49c6-b123-97110e948115 of volume 4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Volume volume-57f2c7ae-e131-4edf-abce-b32e673521cc (57f2c7ae-e131-4edf-abce-b32e673521cc): created successfully Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffddb471-fdd2-4d44-87aa-b7312e3e396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Flow 'volume_create_manager' (48993d3d-1e26-4d35-8071-e641c5230476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ce116-b0ab-4d6e-8d12-ee84dc31a65a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-29993967-1b20-421b-baec-912c60d7deae tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created volume successfully. Sep 01 02:24:20 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-20811534-75dd-4224-ab74-4fdf3657fcd8" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-20811534-75dd-4224-ab74-4fdf3657fcd8" released by "delete_volume" :: held 0.653s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:20 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a Sep 01 02:24:20 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Created reservations ['a092b4e5-323e-4e48-99d0-a2fd787c5fab', '81613491-4d51-40f3-97f4-9cd90c314989', 'bfda0894-d963-409f-9a4c-330d4d35a333', '2b2184c6-a617-4744-b1a7-6ba218d90cfd'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:20 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a" returned: 0 in 0.414s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 1G Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-57f2c7ae-e131-4edf-abce-b32e673521cc-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:21 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-57f2c7ae-e131-4edf-abce-b32e673521cc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Deleted volume successfully. Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6702562c-1155-4ddd-bc7f-850b9e58f90b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-20811534-75dd-4224-ab74-4fdf3657fcd8-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-57f2c7ae-e131-4edf-abce-b32e673521cc" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-57f2c7ae-e131-4edf-abce-b32e673521cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-1c238800-6dda-47a4-9fab-21aa3c6c18d0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-1c238800-6dda-47a4-9fab-21aa3c6c18d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b281254-16bd-4365-95d9-6597fd3fec21]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-quobyte-1c238800-6dda-47a4-9fab-21aa3c6c18d0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-1c238800-6dda-47a4-9fab-21aa3c6c18d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe2aa8-65df-4008-b74a-1cffb393282f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc Sep 01 02:24:21 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 Sep 01 02:24:21 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 1G" returned: 0 in 0.474s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 Sep 01 02:24:21 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc" returned: 0 in 0.401s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc Sep 01 02:24:21 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0 Sep 01 02:24:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115" returned: 0 in 0.309s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 is being set with open permissions: ugo+rw Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 Sep 01 02:24:21 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-57f2c7ae-e131-4edf-abce-b32e673521cc" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-57f2c7ae-e131-4edf-abce-b32e673521cc" released by "delete_volume" :: held 0.739s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['29b5607c-cfa6-403a-a698-9fcb270ddbca', '8eca7ea2-b317-4aa3-8703-c0b6653806de', 'd1140824-0b37-4f20-b08a-f5c4bb268fc6', '781fbcad-24cf-4f6b-985f-62edb423380a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:21 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c238800-6dda-47a4-9fab-21aa3c6c18d0" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-1c238800-6dda-47a4-9fab-21aa3c6c18d0" released by "delete_volume" :: held 0.722s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Created reservations ['93a54586-157f-4d18-a9b7-221e196cde58', 'c623c02f-f459-4691-b464-72a8c7661926', '9d3c7b86-4fb4-4203-91fd-d74eecbebe5e', '667b010c-5efb-43ac-b7a9-de1b8f4897b3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:22 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:22 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info Sep 01 02:24:22 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:22 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-1f2c6879-f664-4774-81c2-84ebeb8803c7-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-1f2c6879-f664-4774-81c2-84ebeb8803c7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4d232d90-309a-49fe-94d8-601efe2d79a0 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-57f2c7ae-e131-4edf-abce-b32e673521cc-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-1f2c6879-f664-4774-81c2-84ebeb8803c7" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-1f2c6879-f664-4774-81c2-84ebeb8803c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[af36b57b-7cf3-4491-ae1e-68f2b32690d9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-eb373a8f-fba2-415b-a0d9-4feedf98f482-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info is being set with open permissions: ugo+rw Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-eb373a8f-fba2-415b-a0d9-4feedf98f482-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:22 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info Sep 01 02:24:22 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "cinder-quobyte-eb373a8f-fba2-415b-a0d9-4feedf98f482" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:22 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.394s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Deleted volume successfully. Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-eb373a8f-fba2-415b-a0d9-4feedf98f482" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:22 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 Sep 01 02:24:22 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-67180c69-a1c1-4901-ad78-4277dcfc2050 tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-1c238800-6dda-47a4-9fab-21aa3c6c18d0-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd807c-4ee0-4387-8b78-bbb6b2d55949]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 Sep 01 02:24:22 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.info" returned: 0 in 0.319s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.830s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713d89f8-4798-4325-b73d-202b09890136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d3fc3f00fd4947888d842e95b2fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:15Z,use_quota=True,user_id='791a3262bfca41458ef2c6af07a23434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4ec5f8-4e43-4724-9bef-ae6c6cb9113d),volume_type_id=0e4ec5f8-4e43-4724-9bef-ae6c6cb9113d)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Creating volume 713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:22 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1073741824 Sep 01 02:24:22 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-05fb09b1-91e0-410d-982a-0141c197b291 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Create snapshot completed successfully Sep 01 02:24:22 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7" returned: 0 in 0.437s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7 Sep 01 02:24:22 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482 Sep 01 02:24:23 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1f2c6879-f664-4774-81c2-84ebeb8803c7" returned: 0 in 0.263s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-1f2c6879-f664-4774-81c2-84ebeb8803c7" released by "delete_volume" :: held 0.743s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['cb53d0ef-0d22-4140-8e51-f4b94d2e2b8e', 'd8e1918a-c7f9-498d-877c-27aca5b47f38', '885e913a-bbcf-4cfd-8123-207f516ff7b1', '6cf6543b-90c9-4d3d-a0fe-4cfce0ba6550'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:23 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-eb373a8f-fba2-415b-a0d9-4feedf98f482" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1073741824" returned: 0 in 0.445s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-quobyte-eb373a8f-fba2-415b-a0d9-4feedf98f482" released by "delete_volume" :: held 0.695s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 Sep 01 02:24:23 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:23 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Created reservations ['0531c7f6-8b17-4d12-8047-fd5edb5acc5f', '3302ba00-1545-4e0a-8ec4-c72e01616c25', 'e4f6d3fa-8b93-4b33-821f-73cb620e6b3d', '802f3939-d161-4aea-8160-8ec106aeeaff'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:23 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:23 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.297s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee847c7-4a0c-49c2-aa21-8ef6e041f35d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3819dfde-a870-406f-810d-47f56abbae4d tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-1f2c6879-f664-4774-81c2-84ebeb8803c7-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:23 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136" returned: 0 in 0.476s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Attempting download of 6831fd7e-fe49-4fa4-90b4-453908945417 ((None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}])) to volume 713d89f8-4798-4325-b73d-202b09890136. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:24:23 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Deleted volume successfully. Sep 01 02:24:23 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce Sep 01 02:24:23 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-074d946e-1d88-400e-a042-3e43e38f2f1b tempest-CreateVolumesFromImageTest-1822878228 None] Lock "cinder-eb373a8f-fba2-415b-a0d9-4feedf98f482-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9091c-6b63-4368-bfde-2fa3b23a6e60]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3 Sep 01 02:24:24 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" returned: 0 in 0.552s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce Sep 01 02:24:24 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3" returned: 0 in 0.454s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (eae1eb86-79cd-4d81-953c-6b6d0eab58c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dea5776-3acf-4b03-a9fe-892566640f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dea5776-3acf-4b03-a9fe-892566640f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056696938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f5273-024a-4f35-9a47-789dee8c0e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:24Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:24 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3 Sep 01 02:24:24 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba9db32-3079-415c-b3d4-a90b92e3764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba9db32-3079-415c-b3d4-a90b92e3764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79823d8-fcfe-4b25-add6-813b30026068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79823d8-fcfe-4b25-add6-813b30026068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082f5273-024a-4f35-9a47-789dee8c0e20', 'volume_name': 'volume-082f5273-024a-4f35-9a47-789dee8c0e20', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7d5cf0-40dc-4ae5-9b23-3f79d7a42426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7d5cf0-40dc-4ae5-9b23-3f79d7a42426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791241d-8df3-4aa5-a7b6-8d81e61a9e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:24 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume 082f5273-024a-4f35-9a47-789dee8c0e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082f5273-024a-4f35-9a47-789dee8c0e20', 'volume_size': 1} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056696938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f5273-024a-4f35-9a47-789dee8c0e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:24Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume 082f5273-024a-4f35-9a47-789dee8c0e20 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:24 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" returned: 0 in 0.491s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 1073741824 Sep 01 02:24:24 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce" released by "delete_volume" :: held 1.127s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (295f537d-d61d-491f-a07e-2bb00575d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf46569e-5a53-4fc1-92b3-63159d1b334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf46569e-5a53-4fc1-92b3-63159d1b334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332045903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e051ae-9645-47f1-973d-24cc7d94ae7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:25Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9f56cc-7835-4dde-b8b9-8ab358d48415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9f56cc-7835-4dde-b8b9-8ab358d48415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b34904-7074-4bb7-bf8a-2fe9a31514fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b34904-7074-4bb7-bf8a-2fe9a31514fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e051ae-9645-47f1-973d-24cc7d94ae7f', 'volume_name': 'volume-82e051ae-9645-47f1-973d-24cc7d94ae7f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f8fd86-6bb0-4169-9bf5-e4b863d1329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f8fd86-6bb0-4169-9bf5-e4b863d1329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7f4cec-f915-427c-b37d-2debe432a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume 82e051ae-9645-47f1-973d-24cc7d94ae7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e051ae-9645-47f1-973d-24cc7d94ae7f', 'volume_size': 1} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['28d25c4e-81d4-49a1-849d-dda38e49292d', '4db62767-6dd6-44d3-905b-df5a3dae5cfb', '953291c7-3612-4460-b3e6-53b772b02adc', '7ce66419-1a37-48cc-a3a2-59b68e657e90'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:25 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3" returned: 1 in 0.677s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6831fd7e-fe49-4fa4-90b4-453908945417_6jbip5f3' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77af882-6706-4e54-bc33-a87e3e96dee7]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:25 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:25 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 1073741824" returned: 0 in 0.688s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.324s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:25 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 Sep 01 02:24:25 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fc6215f3-342f-42ee-905e-b015447cd01f tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-adb89e33-4c1f-40a1-bc2d-bbaa0f86fcce-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:25 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (790e9a1c-6dd1-410a-8f7b-e8a4d38822ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0d6903-1af2-4fcc-9d20-5f1c6cbe4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0d6903-1af2-4fcc-9d20-5f1c6cbe4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481670450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fed95b-a61e-4dbc-b935-df2d368bfd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:26Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e407deb1-08ec-4418-bf12-cd4e5aea24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e407deb1-08ec-4418-bf12-cd4e5aea24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef57e7a-9d57-4d2c-a8b8-fc5ca35f6c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef57e7a-9d57-4d2c-a8b8-fc5ca35f6c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fed95b-a61e-4dbc-b935-df2d368bfd24', 'volume_name': 'volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c531999-25b3-4b3d-96ff-6f0e54a0196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c531999-25b3-4b3d-96ff-6f0e54a0196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d61a172-98df-42d5-9559-4cf6f541c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume e9fed95b-a61e-4dbc-b935-df2d368bfd24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24', 'volume_size': 1} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:25 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD Sep 01 02:24:25 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332045903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e051ae-9645-47f1-973d-24cc7d94ae7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:25Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume 82e051ae-9645-47f1-973d-24cc7d94ae7f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791241d-8df3-4aa5-a7b6-8d81e61a9e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082f5273-024a-4f35-9a47-789dee8c0e20', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e20cd-35a0-4b91-8567-8d16dfcf7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-082f5273-024a-4f35-9a47-789dee8c0e20 (082f5273-024a-4f35-9a47-789dee8c0e20): created successfully Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e20cd-35a0-4b91-8567-8d16dfcf7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (eae1eb86-79cd-4d81-953c-6b6d0eab58c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:25 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f 1073741824 Sep 01 02:24:25 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2b238a6c-59d5-43b4-9d23-5d3a887ee3b9 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-551f7740-6bde-4916-b77f-9d946ecc7ca9-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-551f7740-6bde-4916-b77f-9d946ecc7ca9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-551f7740-6bde-4916-b77f-9d946ecc7ca9" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-551f7740-6bde-4916-b77f-9d946ecc7ca9" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9aa95-95f6-497b-b83e-68cac0df99ee]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD" returned: 1 in 0.591s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] 6831fd7e-fe49-4fa4-90b4-453908945417 was raw, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 Sep 01 02:24:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 Sep 01 02:24:26 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:26 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (5bbee617-a060-40bc-a2fc-ad6344693697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0150580-2d00-4a60-b493-2d4ed06335e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f 1073741824" returned: 0 in 0.697s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0150580-2d00-4a60-b493-2d4ed06335e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000277932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b068a-0416-488b-a4cf-a9cf96b2443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:26Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36e2e9-0e80-4f1d-bf66-47f82b0a9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36e2e9-0e80-4f1d-bf66-47f82b0a9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6c9053-8192-49b5-bb00-a9a4f2b12681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6c9053-8192-49b5-bb00-a9a4f2b12681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20b068a-0416-488b-a4cf-a9cf96b2443f', 'volume_name': 'volume-a20b068a-0416-488b-a4cf-a9cf96b2443f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2696430e-a105-482f-b2b9-a631d7f866c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2696430e-a105-482f-b2b9-a631d7f866c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0404ae36-1d58-4749-be0a-1cdd0128b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:26 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume a20b068a-0416-488b-a4cf-a9cf96b2443f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20b068a-0416-488b-a4cf-a9cf96b2443f', 'volume_size': 1} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:26 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9" returned: 0 in 0.503s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9 Sep 01 02:24:26 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f Sep 01 02:24:26 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (06b1e25f-8f9d-4d66-a564-6f3e4e8e908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b0f356-f268-4213-90b2-396b1d67deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b0f356-f268-4213-90b2-396b1d67deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882077781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e8f464-070c-4c33-bb02-1dbcb2873c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:27Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1e6e82-659d-43d6-9acd-638658bb7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1e6e82-659d-43d6-9acd-638658bb7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f47e6d-7fe5-47a4-ac9b-cbef60445cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f47e6d-7fe5-47a4-ac9b-cbef60445cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e8f464-070c-4c33-bb02-1dbcb2873c1e', 'volume_name': 'volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba00767-90de-4420-b904-15b2a5800878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba00767-90de-4420-b904-15b2a5800878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64e6d25-bc87-45d9-aac5-ceb7b5f23dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume 55e8f464-070c-4c33-bb02-1dbcb2873c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e', 'volume_size': 1} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136" returned: 0 in 0.827s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6831fd7e-fe49-4fa4-90b4-453908945417_nly8squpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-551f7740-6bde-4916-b77f-9d946ecc7ca9" returned: 0 in 0.383s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f" returned: 0 in 0.347s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:27 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1G Sep 01 02:24:27 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481670450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fed95b-a61e-4dbc-b935-df2d368bfd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:26Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume e9fed95b-a61e-4dbc-b935-df2d368bfd24 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7f4cec-f915-427c-b37d-2debe432a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e051ae-9645-47f1-973d-24cc7d94ae7f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 1073741824 Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794f7b45-5b69-4be8-9e22-197329f7d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-551f7740-6bde-4916-b77f-9d946ecc7ca9" released by "delete_volume" :: held 1.001s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-82e051ae-9645-47f1-973d-24cc7d94ae7f (82e051ae-9645-47f1-973d-24cc7d94ae7f): created successfully Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794f7b45-5b69-4be8-9e22-197329f7d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (295f537d-d61d-491f-a07e-2bb00575d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2b75080c-b6c6-4154-b7a9-601aa6283992 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['4a582cf2-a578-420f-a36a-5da91b8b83e8', '5c81b969-6969-43ca-b5b3-a550a0994106', 'caadd708-2bab-4e31-8666-055514d11554', '6eea0b57-28f9-4278-b3b0-5deb67800a8f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:27 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 1G" returned: 0 in 0.463s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Downloaded image 6831fd7e-fe49-4fa4-90b4-453908945417 ((None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}])) to volume 713d89f8-4798-4325-b73d-202b09890136 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Temporary image 6831fd7e-fe49-4fa4-90b4-453908945417 for user 791a3262bfca41458ef2c6af07a23434 is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Marking volume 713d89f8-4798-4325-b73d-202b09890136 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Copying metadata from image 6831fd7e-fe49-4fa4-90b4-453908945417 to 713d89f8-4798-4325-b73d-202b09890136. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Creating volume glance metadata for volume 713d89f8-4798-4325-b73d-202b09890136 backed by image 6831fd7e-fe49-4fa4-90b4-453908945417 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2f7cbdfbf09ea83de3a2623bd644d42', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:24:27 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:27 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750e8aaf-5bc2-4527-90a2-637aefe02069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713d89f8-4798-4325-b73d-202b09890136', 'volume_size': 1, 'image_id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6831fd7e-fe49-4fa4-90b4-453908945417', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f7cbdfbf09ea83de3a2623bd644d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d3fc3f00fd4947888d842e95b2fec1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4535115f4bc7ba93b26b676483895486135dec6d97305f06bcd9c0a48090958f4357d93e6662c43b7309fa1fd1ee47296c63071cb6862c8e9e6f1ec26b5c1658', 'id': '6831fd7e-fe49-4fa4-90b4-453908945417', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6831fd7e-fe49-4fa4-90b4-453908945417/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d2f7ba-9345-4264-b884-52e9e745cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 1073741824" returned: 0 in 0.564s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Volume volume-713d89f8-4798-4325-b73d-202b09890136 (713d89f8-4798-4325-b73d-202b09890136): created successfully Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d2f7ba-9345-4264-b884-52e9e745cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Flow 'volume_create_manager' (22a36579-9e37-4ed8-b952-4aca1c6f4180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f19c9942-ea6d-454f-80ab-8bc7d7994934 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-551f7740-6bde-4916-b77f-9d946ecc7ca9-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fb817524-bd02-4ae4-affe-d80a7cd4ea35 tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Created volume successfully. Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 Sep 01 02:24:27 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Acquiring lock "cinder-713d89f8-4798-4325-b73d-202b09890136-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:27 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "cinder-713d89f8-4798-4325-b73d-202b09890136-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Acquiring lock "cinder-quobyte-713d89f8-4798-4325-b73d-202b09890136" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "cinder-quobyte-713d89f8-4798-4325-b73d-202b09890136" acquired by "delete_volume" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24" returned: 0 in 0.323s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.368s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000277932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b068a-0416-488b-a4cf-a9cf96b2443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:26Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume a20b068a-0416-488b-a4cf-a9cf96b2443f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:28 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5765a2de-8b29-4bc9-9f9e-5c1fbb321b85]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f 1073741824 Sep 01 02:24:28 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d61a172-98df-42d5-9559-4cf6f541c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ff2350-ef65-4c17-a071-078bc3f35a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 (e9fed95b-a61e-4dbc-b935-df2d368bfd24): created successfully Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ff2350-ef65-4c17-a071-078bc3f35a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (790e9a1c-6dd1-410a-8f7b-e8a4d38822ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:28 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-375fc274-98ec-4d45-a3cf-223868b26db1 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Flow 'volume_create_manager' (85784a1a-7d5c-4f77-8dc3-aeb676d4985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:28 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 Sep 01 02:24:28 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6b8c27-61ef-44c1-bec2-bfd4ce09f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6b8c27-61ef-44c1-bec2-bfd4ce09f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2137555126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2584c5c7-b6e2-405f-8de4-b0480aa9b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19fa63632f404023a7788643880e8533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:28Z,use_quota=True,user_id='4e49b06486d84eb89cadcfad1b36a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c66116-bdba-4dcf-8f41-92a081c67536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c66116-bdba-4dcf-8f41-92a081c67536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d95af2-bcc4-4f9f-aa0f-bdcd65ac2322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d95af2-bcc4-4f9f-aa0f-bdcd65ac2322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2584c5c7-b6e2-405f-8de4-b0480aa9b7b0', 'volume_name': 'volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1340fb4-a74b-4ef9-ae0f-75fe6f9a8801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1340fb4-a74b-4ef9-ae0f-75fe6f9a8801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79091211-e487-42b3-8d3f-e69ad1d03ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Volume 2584c5c7-b6e2-405f-8de4-b0480aa9b7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0', 'volume_size': 1} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-c477bbb8-85de-47ee-964b-88c8ed2c790d-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-c477bbb8-85de-47ee-964b-88c8ed2c790d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-c477bbb8-85de-47ee-964b-88c8ed2c790d" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-c477bbb8-85de-47ee-964b-88c8ed2c790d" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03dc33-966c-4be3-9c3f-4bb10264ab82]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136" returned: 0 in 0.460s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136 Sep 01 02:24:28 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f 1073741824" returned: 0 in 0.525s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d Sep 01 02:24:28 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f Sep 01 02:24:28 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-713d89f8-4798-4325-b73d-202b09890136" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "cinder-quobyte-713d89f8-4798-4325-b73d-202b09890136" released by "delete_volume" :: held 0.787s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Created reservations ['ddd05736-c6c6-43f0-93df-5330a7faebe5', '1266da7e-6f39-4c47-8044-b845bad5d3c6', '575e1790-98d5-4d62-8a11-02e9baaf9a08', 'dd0321d7-5b29-46c2-816d-e0e519a3fa0b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:28 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882077781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e8f464-070c-4c33-bb02-1dbcb2873c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d4936c337427b931b1fcd06ce5cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:27Z,use_quota=True,user_id='5046fc37617148c6bb752753ae94365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:28 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Creating volume 55e8f464-070c-4c33-bb02-1dbcb2873c1e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:28 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:28 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e 1073741824 Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0404ae36-1d58-4749-be0a-1cdd0128b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20b068a-0416-488b-a4cf-a9cf96b2443f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2cc4b-8a26-424a-b38b-828238eb991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-a20b068a-0416-488b-a4cf-a9cf96b2443f (a20b068a-0416-488b-a4cf-a9cf96b2443f): created successfully Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2cc4b-8a26-424a-b38b-828238eb991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (5bbee617-a060-40bc-a2fc-ad6344693697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fb99c861-5e1d-4cc5-9914-5af950a701c6 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:29 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c477bbb8-85de-47ee-964b-88c8ed2c790d" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-c477bbb8-85de-47ee-964b-88c8ed2c790d" released by "delete_volume" :: held 0.823s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['410883d8-9196-484a-b5d2-f9c3b593d540', 'f40d3238-19aa-4eea-854d-0274dbccebd0', '74da540c-e24a-4876-a159-7322fb9f33bb', '8ee9273c-868a-427a-95ff-8243ebe3dfc9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:29 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Deleted volume successfully. Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b29dc32a-15e1-4fd9-996a-d7e6721cbdac tempest-VolumeAndVolumeTypeFromImageTest-28195860 None] Lock "cinder-713d89f8-4798-4325-b73d-202b09890136-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:29 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e 1073741824" returned: 0 in 0.646s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-6537b595-be29-46f9-bb16-d0a450659c27-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-6537b595-be29-46f9-bb16-d0a450659c27-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:29 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e Sep 01 02:24:29 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "cinder-quobyte-6537b595-be29-46f9-bb16-d0a450659c27" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-6537b595-be29-46f9-bb16-d0a450659c27" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b01d3d-ab8c-44d8-b85b-b1c5ff642fca]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.323s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-147caa99-087a-43a7-b046-a6d6891a27b1 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-c477bbb8-85de-47ee-964b-88c8ed2c790d-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:29 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 Sep 01 02:24:29 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e" returned: 0 in 0.316s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2137555126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2584c5c7-b6e2-405f-8de4-b0480aa9b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19fa63632f404023a7788643880e8533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:28Z,use_quota=True,user_id='4e49b06486d84eb89cadcfad1b36a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Creating volume 2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:30 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64e6d25-bc87-45d9-aac5-ceb7b5f23dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:30 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 1073741824 Sep 01 02:24:30 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a494f8-c9e3-4cf2-8ebe-8fa56c0125fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Volume volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e (55e8f464-070c-4c33-bb02-1dbcb2873c1e): created successfully Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a494f8-c9e3-4cf2-8ebe-8fa56c0125fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Flow 'volume_create_manager' (06b1e25f-8f9d-4d66-a564-6f3e4e8e908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-100ca06e-d3f8-4877-a476-e118a7812575 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created volume successfully. Sep 01 02:24:30 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27" returned: 0 in 0.394s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27 Sep 01 02:24:30 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-55e8f464-070c-4c33-bb02-1dbcb2873c1e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-55e8f464-070c-4c33-bb02-1dbcb2873c1e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:30 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6537b595-be29-46f9-bb16-d0a450659c27" returned: 0 in 0.312s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-quobyte-6537b595-be29-46f9-bb16-d0a450659c27" released by "delete_volume" :: held 0.753s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:30 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-55e8f464-070c-4c33-bb02-1dbcb2873c1e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 1073741824" returned: 0 in 0.544s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-55e8f464-070c-4c33-bb02-1dbcb2873c1e" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc8220-9540-42a6-8692-52f06b256bb7]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Created reservations ['7daa11ac-6cc2-4e2e-832e-4cf41a356c98', '01a50998-7fef-4d3a-916d-43c823b3bca8', 'd59d4455-bda6-4ca7-84b7-afd8e3f5e22b', 'c0977270-4e3b-49cf-8330-a8b56b4d502e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:30 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:30 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e Sep 01 02:24:30 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:30 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.366s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79091211-e487-42b3-8d3f-e69ad1d03ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54956333-9bf7-4975-993b-3b8698a3f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:31 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Volume volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 (2584c5c7-b6e2-405f-8de4-b0480aa9b7b0): created successfully Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54956333-9bf7-4975-993b-3b8698a3f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Flow 'volume_create_manager' (85784a1a-7d5c-4f77-8dc3-aeb676d4985c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-71379141-56fe-455b-8d94-813f11824a85 tempest-VolumeDependencyTests-1617000634 None] Created volume successfully. Sep 01 02:24:31 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e" returned: 0 in 0.505s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.357s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:31 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e Sep 01 02:24:31 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Deleted volume successfully. Sep 01 02:24:31 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97ec79f9-68ad-45c6-9845-d0620a3fc131 tempest-CreateVolumesFromSourceVolumeTest-1790806266 None] Lock "cinder-6537b595-be29-46f9-bb16-d0a450659c27-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:31 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-55e8f464-070c-4c33-bb02-1dbcb2873c1e" returned: 0 in 0.375s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-55e8f464-070c-4c33-bb02-1dbcb2873c1e" released by "delete_volume" :: held 0.933s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['ca59fc46-ff5c-4763-9165-d086aad40758', '22155e4b-579f-4f1d-8cb5-ed9c65d7658b', 'f8a7bd5b-489a-4ecd-8639-92851bc50876', '238dc1e1-c108-47d1-8517-b1201e55bad3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Creating offline snapshot a21460c7-c147-4cbc-a098-7a293c67ee3e of volume 2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0050efc-ab8f-4349-bad1-653bd6f2bac0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:31 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:31 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:31 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.318s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5c1aa6bc-4955-4837-933f-05d776182d2b tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-55e8f464-070c-4c33-bb02-1dbcb2873c1e-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:32 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.536s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e 1G Sep 01 02:24:32 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-a20b068a-0416-488b-a4cf-a9cf96b2443f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:32 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e 1G" returned: 0 in 0.508s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-a20b068a-0416-488b-a4cf-a9cf96b2443f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:32 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:32 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-a20b068a-0416-488b-a4cf-a9cf96b2443f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-a20b068a-0416-488b-a4cf-a9cf96b2443f" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf5b498-0f11-4414-bbbd-1d22268201e6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f Sep 01 02:24:33 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e is being set with open permissions: ugo+rw Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:33 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f" returned: 0 in 0.475s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f Sep 01 02:24:33 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.309s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info Sep 01 02:24:33 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a20b068a-0416-488b-a4cf-a9cf96b2443f" returned: 0 in 0.345s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-a20b068a-0416-488b-a4cf-a9cf96b2443f" released by "delete_volume" :: held 0.891s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['004816ff-75b5-425e-b84d-d4669abfeb92', '89297af8-4d48-484f-a457-0326207697ea', '820eb720-fa5c-413e-9071-490cdef3e02c', '0673bb38-c16c-459e-8821-e5f4f5e97518'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:33 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info" returned: 0 in 0.314s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info is being set with open permissions: ugo+rw Sep 01 02:24:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info Sep 01 02:24:33 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:34 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:34 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:34 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.info" returned: 0 in 0.299s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-918bfc65-1ae3-4d69-a423-fe66fa50dda5 tempest-VolumeDependencyTests-1617000634 None] Create snapshot completed successfully Sep 01 02:24:34 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.324s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26617ebe-da7c-4a94-8001-169d1c26feab tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-a20b068a-0416-488b-a4cf-a9cf96b2443f-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Flow 'volume_create_manager' (2029454e-4393-48a3-9b9b-677aeca5d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa6bf7-03ca-4861-8ba5-2aceb20f3d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa6bf7-03ca-4861-8ba5-2aceb20f3d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b676d4db-5f1a-4c83-8477-f235b1f2f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433849edf1714eeebbedc5ef316176e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:35Z,use_quota=True,user_id='5da984ba95e64c1ca0827235f8c6de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a22d7-976d-4a6f-a53c-8ae7b3684200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a22d7-976d-4a6f-a53c-8ae7b3684200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6680ba06-fcd5-40c4-805d-17ce9e2078a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6680ba06-fcd5-40c4-805d-17ce9e2078a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b676d4db-5f1a-4c83-8477-f235b1f2f00e', 'volume_name': 'volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76d0711-cf70-47e3-8297-aa6ebb572615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76d0711-cf70-47e3-8297-aa6ebb572615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668080fd-8786-4d98-a51f-3842d171671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Volume b676d4db-5f1a-4c83-8477-f235b1f2f00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e', 'volume_size': 1} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b676d4db-5f1a-4c83-8477-f235b1f2f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433849edf1714eeebbedc5ef316176e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:35Z,use_quota=True,user_id='5da984ba95e64c1ca0827235f8c6de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Creating volume b676d4db-5f1a-4c83-8477-f235b1f2f00e {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:34 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e 1073741824 Sep 01 02:24:35 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-e9fed95b-a61e-4dbc-b935-df2d368bfd24-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-e9fed95b-a61e-4dbc-b935-df2d368bfd24-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-e9fed95b-a61e-4dbc-b935-df2d368bfd24" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-e9fed95b-a61e-4dbc-b935-df2d368bfd24" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1b911-67e1-45f3-bf89-2025d3d05c91]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 Sep 01 02:24:35 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Flow 'volume_create_manager' (a11d57bd-5508-4a6e-ac43-af22da295f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3629043b-3508-4464-b5e5-31f52480f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e 1073741824" returned: 0 in 0.616s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3629043b-3508-4464-b5e5-31f52480f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-895877360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bdb6d4-25b6-4254-b1e8-17997f08072a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19fa63632f404023a7788643880e8533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a21460c7-c147-4cbc-a098-7a293c67ee3e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:35Z,use_quota=True,user_id='4e49b06486d84eb89cadcfad1b36a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3dfe62-3672-43e2-a4e7-1ad4fb11f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3dfe62-3672-43e2-a4e7-1ad4fb11f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca33551f-ba3a-4a76-a07a-f743758c08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca33551f-ba3a-4a76-a07a-f743758c08bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48bdb6d4-25b6-4254-b1e8-17997f08072a', 'volume_name': 'volume-48bdb6d4-25b6-4254-b1e8-17997f08072a', 'volume_size': 1, 'snapshot_id': 'a21460c7-c147-4cbc-a098-7a293c67ee3e'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f1f30b-71b0-4ebc-8894-7e3c79336350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f1f30b-71b0-4ebc-8894-7e3c79336350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a06aaf-57c4-4292-ab07-5b943cb27329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Volume 48bdb6d4-25b6-4254-b1e8-17997f08072a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48bdb6d4-25b6-4254-b1e8-17997f08072a', 'volume_size': 1, 'snapshot_id': 'a21460c7-c147-4cbc-a098-7a293c67ee3e'} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24" returned: 0 in 0.494s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e Sep 01 02:24:35 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24 Sep 01 02:24:35 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:35 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.302s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e-48bdb6d4-25b6-4254-b1e8-17997f08072a" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-e9fed95b-a61e-4dbc-b935-df2d368bfd24" returned: 0 in 0.278s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668080fd-8786-4d98-a51f-3842d171671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4b9082-bec9-4c6b-b499-34bff8c4613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e-48bdb6d4-25b6-4254-b1e8-17997f08072a" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Creating volume 48bdb6d4-25b6-4254-b1e8-17997f08072a from snapshot a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-e9fed95b-a61e-4dbc-b935-df2d368bfd24" released by "delete_volume" :: held 0.847s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:36 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Volume volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e (b676d4db-5f1a-4c83-8477-f235b1f2f00e): created successfully Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4b9082-bec9-4c6b-b499-34bff8c4613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Flow 'volume_create_manager' (2029454e-4393-48a3-9b9b-677aeca5d564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] snapshot: a21460c7-c147-4cbc-a098-7a293c67ee3e, volume: 48bdb6d4-25b6-4254-b1e8-17997f08072a, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c616af21-46c7-46d2-bb61-eb324da82086 tempest-CinderUnicodeTest-449072564 None] Created volume successfully. Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6deea3-4142-4501-a0da-8dfa94b31a90]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['ec0d9222-bffc-43e7-b75a-77ac7aded3bb', '0763c1eb-69a2-4272-b757-fb573e3a8d39', '0f2a1730-3406-4ff6-8102-8fd57f7e887b', 'ac25ce49-0b92-4b10-8d59-e9f45dea399d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:36 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:36 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:36 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:36 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:36 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dca4a977-0a4d-45e4-92d6-a1b3cb2b0ec5 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-e9fed95b-a61e-4dbc-b935-df2d368bfd24-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:36 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.444s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add4050-f84a-40eb-b687-6ca4b80d9e27]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:36 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:36 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:36 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:24:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:37 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a Sep 01 02:24:37 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-82e051ae-9645-47f1-973d-24cc7d94ae7f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-82e051ae-9645-47f1-973d-24cc7d94ae7f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-82e051ae-9645-47f1-973d-24cc7d94ae7f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-82e051ae-9645-47f1-973d-24cc7d94ae7f" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321e273-386d-45a9-81cd-e8ea8413fd0c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:37 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f Sep 01 02:24:37 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Flow 'volume_create_manager' (88e71c81-1411-42c1-9d48-9449fd2fd738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000382c3-442d-404f-a997-a68598efa57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000382c3-442d-404f-a997-a68598efa57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-288377581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f52f4-df5c-4643-8b8d-f71add2b7c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433849edf1714eeebbedc5ef316176e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:38Z,use_quota=True,user_id='5da984ba95e64c1ca0827235f8c6de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56176a5-fe57-4770-a548-b4c33ed71d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56176a5-fe57-4770-a548-b4c33ed71d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33774359-5084-4a8e-bb11-a971826c9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33774359-5084-4a8e-bb11-a971826c9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697f52f4-df5c-4643-8b8d-f71add2b7c91', 'volume_name': 'volume-697f52f4-df5c-4643-8b8d-f71add2b7c91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c216452-cdec-4070-910d-630c6080921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c216452-cdec-4070-910d-630c6080921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e9e0a-3171-401b-a70b-133a83e54d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Volume 697f52f4-df5c-4643-8b8d-f71add2b7c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697f52f4-df5c-4643-8b8d-f71add2b7c91', 'volume_size': 1} Sep 01 02:24:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:38 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f" returned: 0 in 0.865s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:38 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f Sep 01 02:24:38 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:39 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-82e051ae-9645-47f1-973d-24cc7d94ae7f" returned: 0 in 0.644s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-82e051ae-9645-47f1-973d-24cc7d94ae7f" released by "delete_volume" :: held 1.600s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['53d0ff8f-f1bb-412b-9500-347157347f81', '80ad8a08-a431-44f2-a0b9-34764331038d', '8a00cf4b-9479-4003-bb90-8ca38d6fc1d1', '862d83a0-991f-4256-a8a2-ee5cf5373501'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:39 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:39 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-082f5273-024a-4f35-9a47-789dee8c0e20-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-082f5273-024a-4f35-9a47-789dee8c0e20-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-082f5273-024a-4f35-9a47-789dee8c0e20" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-082f5273-024a-4f35-9a47-789dee8c0e20" acquired by "delete_volume" :: waited 0.040s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[253fdd67-77e8-4017-9ff6-d95f44c1fa0b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:40 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.744s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ec5977ff-be05-4ec9-9971-7984ab83c404 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-82e051ae-9645-47f1-973d-24cc7d94ae7f-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:40 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 Sep 01 02:24:40 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:41 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20" returned: 0 in 1.195s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20 Sep 01 02:24:41 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.843s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:24:41 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-082f5273-024a-4f35-9a47-789dee8c0e20" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-082f5273-024a-4f35-9a47-789dee8c0e20" released by "delete_volume" :: held 1.772s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['a64b1d28-6970-44cc-8312-5c2a90e8eb87', '63781484-5736-4968-b24d-233ddd279f8f', '02c6add2-1948-440d-920d-9a53aa4b4c89', '6d47c311-ca7d-4bdb-bd67-4dc97d660052'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:42 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-e700e5bb-b95d-49c6-b123-97110e948115-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-e700e5bb-b95d-49c6-b123-97110e948115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-e700e5bb-b95d-49c6-b123-97110e948115" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-e700e5bb-b95d-49c6-b123-97110e948115" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleting offline snapshot e700e5bb-b95d-49c6-b123-97110e948115 of volume 4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] snapshot_file for this snap is: volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dfdc1a-1ed5-4579-8aac-048ae481fb8b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 Sep 01 02:24:42 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:42 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a" returned: 0 in 5.974s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:24:42 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Converted 1024.00 MB image at 171.38 MB/s Sep 01 02:24:42 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a is being set with open permissions: ugo+rw Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.798s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:42 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a Sep 01 02:24:42 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:42 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-980aa0e8-e852-401c-986a-825158c3e29c tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-082f5273-024a-4f35-9a47-789dee8c0e20-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115" returned: 0 in 0.512s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2425e637-1f20-4fdd-b98a-51be3eddb25d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a" returned: 0 in 0.289s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" released by "_copy_volume_from_snapshot" :: held 7.199s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e-48bdb6d4-25b6-4254-b1e8-17997f08072a" released by "_create_volume_from_snapshot" :: held 7.301s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.344s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.461s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-288377581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f52f4-df5c-4643-8b8d-f71add2b7c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433849edf1714eeebbedc5ef316176e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:38Z,use_quota=True,user_id='5da984ba95e64c1ca0827235f8c6de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Creating volume 697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:43 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 1073741824 Sep 01 02:24:43 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a06aaf-57c4-4292-ab07-5b943cb27329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bdb6d4-25b6-4254-b1e8-17997f08072a', 'volume_size': 1, 'snapshot_id': 'a21460c7-c147-4cbc-a098-7a293c67ee3e'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a Sep 01 02:24:43 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9174090-8de4-41cf-9294-b93d49c5c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Volume volume-48bdb6d4-25b6-4254-b1e8-17997f08072a (48bdb6d4-25b6-4254-b1e8-17997f08072a): created successfully Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9174090-8de4-41cf-9294-b93d49c5c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Flow 'volume_create_manager' (a11d57bd-5508-4a6e-ac43-af22da295f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:43 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0ec3d484-0b5a-43dc-b795-125e4e267065 tempest-VolumeDependencyTests-1617000634 None] Created volume successfully. Sep 01 02:24:43 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a" returned: 0 in 0.446s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 Sep 01 02:24:43 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (b0f65291-d412-484e-ac28-3e7ced4e5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caececd6-addc-41d8-9998-6cc9d6ddf9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caececd6-addc-41d8-9998-6cc9d6ddf9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581730501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88081e-d121-464d-b77b-5c3feab49939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:44Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005df9e-dbf1-414b-95d0-08d3959c16a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005df9e-dbf1-414b-95d0-08d3959c16a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affb9bd5-b0aa-4761-a266-aca6cd652a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affb9bd5-b0aa-4761-a266-aca6cd652a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e88081e-d121-464d-b77b-5c3feab49939', 'volume_name': 'volume-5e88081e-d121-464d-b77b-5c3feab49939', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e28ed-2fc1-4116-a515-512e20162bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e28ed-2fc1-4116-a515-512e20162bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5d7ff-6ff0-4d51-843a-1e0e78e608f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:43 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Volume 5e88081e-d121-464d-b77b-5c3feab49939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e88081e-d121-464d-b77b-5c3feab49939', 'volume_size': 1} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:43 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 1073741824" returned: 0 in 0.561s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 Sep 01 02:24:43 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115" returned: 0 in 0.366s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115 Sep 01 02:24:44 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581730501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88081e-d121-464d-b77b-5c3feab49939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:44Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Creating volume 5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:44 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e9e0a-3171-401b-a70b-133a83e54d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697f52f4-df5c-4643-8b8d-f71add2b7c91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 1073741824 Sep 01 02:24:44 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cbc6e0-58d5-410f-8633-04069287fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Volume volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 (697f52f4-df5c-4643-8b8d-f71add2b7c91): created successfully Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cbc6e0-58d5-410f-8633-04069287fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Flow 'volume_create_manager' (88e71c81-1411-42c1-9d48-9449fd2fd738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-16a8ef82-394f-4479-aa48-a41229af4ccf tempest-CinderUnicodeTest-449072564 None] Created volume successfully. Sep 01 02:24:44 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a.e700e5bb-b95d-49c6-b123-97110e948115" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-e700e5bb-b95d-49c6-b123-97110e948115" released by "_delete_snapshot" :: held 1.768s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" released by "delete_snapshot" :: held 1.820s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['0b96fef5-3b91-4ddc-9011-42c4088ab398', '043a34dd-c33b-4842-b587-d657046c1e88', 'e2a822c3-e303-44d0-bb8b-69fe35892cee', 'e5005424-39f7-4422-846c-b6e286083da9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-a21460c7-c147-4cbc-a098-7a293c67ee3e-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Delete snapshot completed successfully. Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-a21460c7-c147-4cbc-a098-7a293c67ee3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-2f9342dd-715d-40cf-9c58-368bda259904 tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-e700e5bb-b95d-49c6-b123-97110e948115-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Deleting offline snapshot a21460c7-c147-4cbc-a098-7a293c67ee3e of volume 2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] snapshot_file for this snap is: volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9bd06e-59ad-4202-9ce7-2fcd183a3d18]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-4000c371-2c3f-4303-a7c5-7b72ec76a09a-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-4000c371-2c3f-4303-a7c5-7b72ec76a09a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:44 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 1073741824" returned: 0 in 0.593s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" acquired by "delete_volume" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5b8cd-ec2c-4767-a234-6f91d1c3d618]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 Sep 01 02:24:44 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a Sep 01 02:24:45 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:45 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.482s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8e7bc4-7842-4396-9a08-4c050633b84b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939" returned: 0 in 0.309s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c5d7ff-6ff0-4d51-843a-1e0e78e608f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e88081e-d121-464d-b77b-5c3feab49939', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875de512-73c8-4fdc-a1db-fd4749c41f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Creating offline snapshot 64bb0b1a-03cc-4c34-b92f-62abe98d1eec of volume 697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:45 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:45 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Volume volume-5e88081e-d121-464d-b77b-5c3feab49939 (5e88081e-d121-464d-b77b-5c3feab49939): created successfully Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875de512-73c8-4fdc-a1db-fd4749c41f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (b0f65291-d412-484e-ac28-3e7ced4e5026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa9b22d-5cbd-4f99-b45b-e6b109ec16ab]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2090c516-152b-4644-950f-00997d0da85a tempest-ProjectReaderTests-1632631066 None] Created volume successfully. Sep 01 02:24:45 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a" returned: 0 in 0.477s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a Sep 01 02:24:45 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 Sep 01 02:24:45 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4000c371-2c3f-4303-a7c5-7b72ec76a09a" returned: 0 in 0.271s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-quobyte-4000c371-2c3f-4303-a7c5-7b72ec76a09a" released by "delete_volume" :: held 0.827s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:45 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Created reservations ['f9f75c09-53b2-472d-ba39-da11da43667e', '981184ca-4eb2-43c3-9433-9a1c50f5040c', '32891719-c38e-425d-99c2-2e2188d42ff9', 'ca2036d1-29e8-44a7-a887-434fe00ff979'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91" returned: 0 in 0.425s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.595s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec 1G Sep 01 02:24:45 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:45 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:45 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:46 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.356s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Deleted volume successfully. Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-cfbdbb42-0cb6-49fb-9d39-789258e5e57f tempest-CreateVolumesFromSnapshotTest-1583094967 None] Lock "cinder-4000c371-2c3f-4303-a7c5-7b72ec76a09a-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:46 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec 1G" returned: 0 in 0.554s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.550s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec Sep 01 02:24:46 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e Sep 01 02:24:46 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0.a21460c7-c147-4cbc-a098-7a293c67ee3e" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec" returned: 0 in 0.336s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec is being set with open permissions: ugo+rw Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-a21460c7-c147-4cbc-a098-7a293c67ee3e" released by "_delete_snapshot" :: held 2.042s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" released by "delete_snapshot" :: held 2.072s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:46 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec Sep 01 02:24:46 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Created reservations ['1f48993f-987d-477f-805f-a6bf456ab614', 'e32b6623-9047-4a81-83e3-8eaab2d372c4', '61d5133f-8e23-49bd-bacb-45e12b2f0ca5', '4e53900b-ef6a-435c-b263-4aea96a57d62'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Delete snapshot completed successfully. Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3db12314-fef1-4e69-94f2-c74169fc8a2a tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-a21460c7-c147-4cbc-a098-7a293c67ee3e-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:46 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec" returned: 0 in 0.294s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info Sep 01 02:24:46 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:47 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info is being set with open permissions: ugo+rw Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:47 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info Sep 01 02:24:47 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.info" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.341s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Creating offline snapshot 0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 of volume 5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4218ea78-548e-4f6b-b1b4-036ff292fa29 tempest-CinderUnicodeTest-449072564 None] Create snapshot completed successfully Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[634acc8f-f39a-46df-b6c3-d05a4f57978d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:47 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 Sep 01 02:24:47 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" acquired by "delete_volume" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea357d-a664-4c52-b397-d16771ad244a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939" returned: 0 in 0.430s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:48 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 1G Sep 01 02:24:48 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-64bb0b1a-03cc-4c34-b92f-62abe98d1eec-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-64bb0b1a-03cc-4c34-b92f-62abe98d1eec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.498s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-quobyte-64bb0b1a-03cc-4c34-b92f-62abe98d1eec" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0 Sep 01 02:24:48 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-64bb0b1a-03cc-4c34-b92f-62abe98d1eec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Deleting offline snapshot 64bb0b1a-03cc-4c34-b92f-62abe98d1eec of volume 697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] snapshot_file for this snap is: volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[db368f31-d315-4f0b-bd0f-97c7714e0bef]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 1G" returned: 0 in 0.530s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e88081e-d121-464d-b77b-5c3feab49939 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e88081e-d121-464d-b77b-5c3feab49939 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 Sep 01 02:24:48 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec Sep 01 02:24:48 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" returned: 0 in 0.324s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0" released by "delete_volume" :: held 0.913s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Created reservations ['14b5a91d-41b6-4a7f-8399-57f2d46c1603', '4c9638c6-9ae8-4ee4-844b-4f4962ad3dd0', '3e185b3b-dea4-4995-a5ab-375e59ce9317', '51870d85-9641-489b-8855-6305e1eb2ab4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:48 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e88081e-d121-464d-b77b-5c3feab49939 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" returned: 0 in 0.403s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 is being set with open permissions: ugo+rw Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:48 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 Sep 01 02:24:48 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec" returned: 0 in 0.522s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697f52f4-df5c-4643-8b8d-f71add2b7c91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-48bdb6d4-25b6-4254-b1e8-17997f08072a-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8436ba7-14d4-408a-8edb-463178ff9039]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-48bdb6d4-25b6-4254-b1e8-17997f08072a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" acquired by "delete_volume" :: waited 0.033s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:49 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1cbbb-a0a7-4ea7-8946-84670d81dc5f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:49 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" returned: 0 in 0.350s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a Sep 01 02:24:49 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info Sep 01 02:24:49 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.475s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:49 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Deleted volume successfully. Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-98d77b36-859e-46d6-8cf6-ec92accbae17 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-2584c5c7-b6e2-405f-8de4-b0480aa9b7b0-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:49 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91" returned: 0 in 0.591s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec Sep 01 02:24:49 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a" returned: 0 in 0.455s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a Sep 01 02:24:49 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info" returned: 0 in 0.450s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info is being set with open permissions: ugo+rw Sep 01 02:24:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info Sep 01 02:24:49 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:50 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec" returned: 0 in 0.363s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-48bdb6d4-25b6-4254-b1e8-17997f08072a" returned: 0 in 0.328s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-quobyte-48bdb6d4-25b6-4254-b1e8-17997f08072a" released by "delete_volume" :: held 0.862s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec Sep 01 02:24:50 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:50 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.info" returned: 0 in 0.282s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fb975da2-35f6-4001-a675-5ba54e59ed8b tempest-ProjectReaderTests-1632631066 None] Create snapshot completed successfully Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Created reservations ['42b97558-b430-48ee-aace-81b456ce9896', 'f574b8cb-51dc-4691-aca2-9c11a7342d97', '6e8bf272-b309-4b9c-aaf1-86b87cc58bdf', 'f9783bfd-dcd2-4b36-a952-28768a28ea03'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:50 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:50 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91.64bb0b1a-03cc-4c34-b92f-62abe98d1eec" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-64bb0b1a-03cc-4c34-b92f-62abe98d1eec" released by "_delete_snapshot" :: held 1.967s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" released by "delete_snapshot" :: held 1.999s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Created reservations ['570ed90c-c9b3-43fc-a16a-8708e5bf2ca1', 'bad9ad91-f945-4cb5-8bee-7ab187088b37', '768d1948-baec-44c0-aeb9-df65acafd1ee', '5900fc63-61a5-4bd5-8ca0-86b21e918943'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:50 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.317s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Deleted volume successfully. Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7fd5f09-a5ba-4f30-b8f3-4ac16cfcce93 tempest-VolumeDependencyTests-1617000634 None] Lock "cinder-48bdb6d4-25b6-4254-b1e8-17997f08072a-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Delete snapshot completed successfully. Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-64bd2653-f117-4acf-bf8d-f849f6cca5ec tempest-CinderUnicodeTest-449072564 None] Lock "cinder-64bb0b1a-03cc-4c34-b92f-62abe98d1eec-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Deleting offline snapshot 0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 of volume 5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] snapshot_file for this snap is: volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992e56e-53d7-41eb-ba3f-d7af628a5abc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 Sep 01 02:24:50 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e88081e-d121-464d-b77b-5c3feab49939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba808a-4167-4c18-af59-586c21675845]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:51 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 Sep 01 02:24:51 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939" returned: 0 in 0.436s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-697f52f4-df5c-4643-8b8d-f71add2b7c91-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:51 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 Sep 01 02:24:51 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-697f52f4-df5c-4643-8b8d-f71add2b7c91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[218414ff-e524-4571-8e82-527dba50a905]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 Sep 01 02:24:52 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" returned: 0 in 0.540s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843 Sep 01 02:24:52 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91" returned: 0 in 0.578s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91 Sep 01 02:24:52 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Flow 'volume_create_manager' (206a5c64-1249-4fe4-9e23-cdf6180ff6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec040e9-3f58-4cec-a189-cd18af0c878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec040e9-3f58-4cec-a189-cd18af0c878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5227a8ad-a2f1-4047-9a49-729d7a225fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5b554f9c5040d1961b2e2079d8e36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:52Z,use_quota=True,user_id='5ffdab26f22e4a29862a4dc226d8d0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3e6e57-7b96-4e5d-9960-c22e2ab5785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3e6e57-7b96-4e5d-9960-c22e2ab5785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3762c-4beb-4fd0-9ee9-3a8f8f1192a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.image.glance [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Creating Keystone auth plugin from conf {{(pid=86925) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:24:52 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939.0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" returned: 0 in 0.399s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843" released by "_delete_snapshot" :: held 1.897s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" released by "delete_snapshot" :: held 1.929s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Created reservations ['d1178a49-fff2-475a-8a7e-63dbbac43241', '1e3d5a91-ad59-4b42-8463-221f652a9c02', 'ae983562-8aeb-4253-8b9d-409829f4daf2', 'aa4cd63b-e375-453a-b527-a72c93ecd96b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:52 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-697f52f4-df5c-4643-8b8d-f71add2b7c91" returned: 0 in 0.434s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Delete snapshot completed successfully. Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-697f52f4-df5c-4643-8b8d-f71add2b7c91" released by "delete_volume" :: held 1.106s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-17e67c04-27ea-47b7-bc74-9a8c045b841e tempest-ProjectReaderTests-1632631066 None] Lock "cinder-0e3e1aa9-0e63-4db2-9414-2bb20eeb3843-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-5e88081e-d121-464d-b77b-5c3feab49939-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Created reservations ['41e18d50-d6fe-4759-9735-12b2121ad514', '0d278aba-526d-4e3d-a54b-1e1f7e045354', '99f5237a-1128-4a2d-a0a6-11c7160678cd', '3b5d9558-11b2-4769-a119-8775b4cd6ab9'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "cinder-5e88081e-d121-464d-b77b-5c3feab49939-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" acquired by "delete_volume" :: waited 0.042s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379c4e0-6cb3-4055-9b8c-c26a2c00dc9a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:53 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3762c-4beb-4fd0-9ee9-3a8f8f1192a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5227a8ad-a2f1-4047-9a49-729d7a225fa3', 'volume_name': 'volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3', 'volume_size': 1, 'image_id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be90cc3d016a49a663399df7998f500c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff5b554f9c5040d1961b2e2079d8e36a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13544725315b29d1c51d028d1d7d758f3fbf7d065729d774bca9c29eddfd3ad0da6acd810134b50aea0f119e420e12833d148a6c13be1fb9d7b6770320287b4b', 'id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/859cfdc5-cf62-4bb2-83e1-6b3955160812/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb745e7-0fec-4626-afb1-e94bc68b0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb745e7-0fec-4626-afb1-e94bc68b0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b9b9d4-c190-4030-b5bf-836be621b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:53 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3', 'volume_size': 1, 'image_id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be90cc3d016a49a663399df7998f500c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff5b554f9c5040d1961b2e2079d8e36a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13544725315b29d1c51d028d1d7d758f3fbf7d065729d774bca9c29eddfd3ad0da6acd810134b50aea0f119e420e12833d148a6c13be1fb9d7b6770320287b4b', 'id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/859cfdc5-cf62-4bb2-83e1-6b3955160812/file', 'properties': {}}, 'image_service': } Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Trying to clone 5227a8ad-a2f1-4047-9a49-729d7a225fa3 from image 859cfdc5-cf62-4bb2-83e1-6b3955160812 at location (None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}]). {{(pid=86925) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:24:53 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 Sep 01 02:24:53 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:24:53 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1c2dd4-5ee0-4d9d-a8c5-1e1f35a1f0e0]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:53 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Deleted volume successfully. Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-7b623efa-e427-4ffe-89b2-8be258b9a623 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-697f52f4-df5c-4643-8b8d-f71add2b7c91-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:53 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:53 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939" returned: 0 in 0.470s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939 Sep 01 02:24:53 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5e88081e-d121-464d-b77b-5c3feab49939" returned: 0 in 0.257s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-5e88081e-d121-464d-b77b-5c3feab49939" released by "delete_volume" :: held 0.820s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:53 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:53 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Created reservations ['f2efe786-18a5-4034-8d51-818c2197b688', '2eac76f2-ffc9-48ca-8d73-18aef198184c', '229f07dd-377f-4993-8ffb-030c0a772485', '2a804b91-3d3c-4a0b-9916-6a1118ba756e'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:53 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-b676d4db-5f1a-4c83-8477-f235b1f2f00e-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-b676d4db-5f1a-4c83-8477-f235b1f2f00e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "cinder-quobyte-b676d4db-5f1a-4c83-8477-f235b1f2f00e" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-b676d4db-5f1a-4c83-8477-f235b1f2f00e" acquired by "delete_volume" :: waited 0.060s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:54 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:54 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[de46773f-b333-4ab1-945f-4838c07b9596]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Temporary image 859cfdc5-cf62-4bb2-83e1-6b3955160812 is fetched for user 5ffdab26f22e4a29862a4dc226d8d0cd. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecaba66-a991-4651-b779-06f4ebb5f910]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e Sep 01 02:24:54 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.392s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Deleted volume successfully. Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-69eec9ed-bf41-46c4-8117-510517e0b4fd tempest-ProjectReaderTests-1632631066 None] Lock "cinder-5e88081e-d121-464d-b77b-5c3feab49939-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:54 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:54 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:54 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (1b190d11-ba7d-42e3-bde9-c6a22d54eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a4372c-74fb-4a61-9621-e9b94b9763e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e" returned: 0 in 0.618s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e Sep 01 02:24:54 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a4372c-74fb-4a61-9621-e9b94b9763e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081021974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d40f5e-005a-433b-b096-ae2fe6a45db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:55Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41ff204-aee9-43ce-b9d0-c2eb8b4f6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41ff204-aee9-43ce-b9d0-c2eb8b4f6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a63314b-5fd1-4bb6-9883-e1ba99fb26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a63314b-5fd1-4bb6-9883-e1ba99fb26f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d40f5e-005a-433b-b096-ae2fe6a45db9', 'volume_name': 'volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec52b5-647d-4224-85c2-fc138e6e653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec52b5-647d-4224-85c2-fc138e6e653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b169c77d-5c86-407c-afcc-776850029d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:54 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Volume f2d40f5e-005a-433b-b096-ae2fe6a45db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9', 'volume_size': 1} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081021974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d40f5e-005a-433b-b096-ae2fe6a45db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:55Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Creating volume f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:54 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 1073741824 Sep 01 02:24:54 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:55 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b676d4db-5f1a-4c83-8477-f235b1f2f00e" returned: 0 in 0.268s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-quobyte-b676d4db-5f1a-4c83-8477-f235b1f2f00e" released by "delete_volume" :: held 0.954s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Created reservations ['990b9977-7e56-4dcd-8c24-d7d167c5fc45', 'e11927bd-df2e-4f64-a229-6bc7bc08b09c', 'e68e4250-4b2a-444c-9b7d-813a17e350a0', '92ea27ab-7541-4ab3-88fb-889853c46251'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:24:55 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:55 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 1073741824" returned: 0 in 0.556s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 Sep 01 02:24:55 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.307s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Deleted volume successfully. Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-ebfea420-1217-4ce9-87c6-c5e430f76b58 tempest-CinderUnicodeTest-449072564 None] Lock "cinder-b676d4db-5f1a-4c83-8477-f235b1f2f00e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:55 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9" returned: 0 in 0.303s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5227a8ad-a2f1-4047-9a49-729d7a225fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5b554f9c5040d1961b2e2079d8e36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:52Z,use_quota=True,user_id='5ffdab26f22e4a29862a4dc226d8d0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Creating volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:55 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1073741824 Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b169c77d-5c86-407c-afcc-776850029d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:55 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8446f9e2-e7e8-4a47-a74d-084c05326c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:55 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Volume volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 (f2d40f5e-005a-433b-b096-ae2fe6a45db9): created successfully Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8446f9e2-e7e8-4a47-a74d-084c05326c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:55 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (1b190d11-ba7d-42e3-bde9-c6a22d54eb66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3c8c3fa6-8352-4927-b3e9-3f2cfc7ac674 tempest-ProjectReaderTests-1632631066 None] Created volume successfully. Sep 01 02:24:56 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1073741824" returned: 0 in 0.448s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:56 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 Sep 01 02:24:56 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:56 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3" returned: 0 in 0.303s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Attempting download of 859cfdc5-cf62-4bb2-83e1-6b3955160812 ((None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}])) to volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b57c96-ce6b-49db-b275-3673377466b7]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:56 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56 Sep 01 02:24:56 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:57 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56" returned: 0 in 0.383s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:57 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56 Sep 01 02:24:57 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Creating offline snapshot 1a4c8777-aba8-4e6f-a6c3-0708192eb18c of volume f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40c30b-8e11-447c-89e1-a84a486131dd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:57 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 Sep 01 02:24:57 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:57 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56" returned: 1 in 0.404s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_859cfdc5-cf62-4bb2-83e1-6b3955160812_c98fac56' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8af354-497a-40ba-82e6-5f6fae3367a9]: (4, 'raw') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:57 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:57 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:57 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9" returned: 0 in 0.547s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:57 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c 1G Sep 01 02:24:57 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:57 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD Sep 01 02:24:58 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] 859cfdc5-cf62-4bb2-83e1-6b3955160812 was raw, converting to qcow2 {{(pid=86925) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:24:58 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c 1G" returned: 0 in 0.563s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 Sep 01 02:24:58 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c Sep 01 02:24:58 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c" returned: 0 in 0.351s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c is being set with open permissions: ugo+rw Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c Sep 01 02:24:58 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3" returned: 0 in 0.585s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_859cfdc5-cf62-4bb2-83e1-6b3955160812_5umjbyxjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:24:58 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:24:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1G Sep 01 02:24:58 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:59 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c" returned: 0 in 0.405s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:59 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info Sep 01 02:24:59 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:59 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 1G" returned: 0 in 0.410s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Downloaded image 859cfdc5-cf62-4bb2-83e1-6b3955160812 ((None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}])) to volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3 successfully. {{(pid=86925) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Temporary image 859cfdc5-cf62-4bb2-83e1-6b3955160812 for user 5ffdab26f22e4a29862a4dc226d8d0cd is deleted. {{(pid=86925) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.volume_utils [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Marking volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3 as bootable. {{(pid=86925) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Copying metadata from image 859cfdc5-cf62-4bb2-83e1-6b3955160812 to 5227a8ad-a2f1-4047-9a49-729d7a225fa3. {{(pid=86925) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Creating volume glance metadata for volume 5227a8ad-a2f1-4047-9a49-729d7a225fa3 backed by image 859cfdc5-cf62-4bb2-83e1-6b3955160812 with: {'image_id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be90cc3d016a49a663399df7998f500c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86925) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b9b9d4-c190-4030-b5bf-836be621b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3', 'volume_size': 1, 'image_id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/859cfdc5-cf62-4bb2-83e1-6b3955160812', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be90cc3d016a49a663399df7998f500c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff5b554f9c5040d1961b2e2079d8e36a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13544725315b29d1c51d028d1d7d758f3fbf7d065729d774bca9c29eddfd3ad0da6acd810134b50aea0f119e420e12833d148a6c13be1fb9d7b6770320287b4b', 'id': '859cfdc5-cf62-4bb2-83e1-6b3955160812', 'created_at': datetime.datetime(2026, 9, 1, 0, 24, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/859cfdc5-cf62-4bb2-83e1-6b3955160812/file', 'properties': {}}, 'image_service': }' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3fc4e4-0faa-45a2-978c-691a9a71031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:59 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info" returned: 0 in 0.338s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info is being set with open permissions: ugo+rw Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:59 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Volume volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 (5227a8ad-a2f1-4047-9a49-729d7a225fa3): created successfully Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3fc4e4-0faa-45a2-978c-691a9a71031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:59 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Flow 'volume_create_manager' (206a5c64-1249-4fe4-9e23-cdf6180ff6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:59 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-db46cf62-3528-45e2-aa9e-6166d3ad1884 tempest-VolumeImageDependencyTests-903246502 None] Created volume successfully. Sep 01 02:24:59 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.info" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a896d38d-621e-4606-8c31-03e9c29f1022 tempest-ProjectReaderTests-1632631066 None] Create snapshot completed successfully Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Acquiring lock "cinder-5227a8ad-a2f1-4047-9a49-729d7a225fa3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "cinder-5227a8ad-a2f1-4047-9a49-729d7a225fa3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Acquiring lock "cinder-quobyte-5227a8ad-a2f1-4047-9a49-729d7a225fa3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "cinder-quobyte-5227a8ad-a2f1-4047-9a49-729d7a225fa3" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b478b2-dccf-4426-9228-24d0892e3702]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:00 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 Sep 01 02:25:00 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-1a4c8777-aba8-4e6f-a6c3-0708192eb18c-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-1a4c8777-aba8-4e6f-a6c3-0708192eb18c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-1a4c8777-aba8-4e6f-a6c3-0708192eb18c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-1a4c8777-aba8-4e6f-a6c3-0708192eb18c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Deleting offline snapshot 1a4c8777-aba8-4e6f-a6c3-0708192eb18c of volume f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] snapshot_file for this snap is: volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630b213-a459-4fc9-8844-adc85a4cbf1e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:00 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3" returned: 0 in 0.473s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:00 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3 Sep 01 02:25:00 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:00 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c Sep 01 02:25:00 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:00 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-5227a8ad-a2f1-4047-9a49-729d7a225fa3" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "cinder-quobyte-5227a8ad-a2f1-4047-9a49-729d7a225fa3" released by "delete_volume" :: held 0.861s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:01 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c" returned: 0 in 0.483s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Created reservations ['2b28d5de-5ef9-428c-b88f-91415521528b', 'b7e33d20-415a-47e3-aac8-6d9b6b252e5c', '8a83b718-61c7-4aa3-933b-8e1ffd1f12d3', '490b4877-aac0-4ab3-8f8b-c1735c258fb5'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[047db91f-402a-42ee-a699-33b3ded22fb0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:01 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:01 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:01 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 Sep 01 02:25:01 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:01 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:01 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Deleted volume successfully. Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-140ea49c-94e8-4bf9-bee0-ce4ae98491ec tempest-VolumeImageDependencyTests-903246502 None] Lock "cinder-5227a8ad-a2f1-4047-9a49-729d7a225fa3-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:01 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9" returned: 0 in 0.675s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:01 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c Sep 01 02:25:01 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:02 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c" returned: 0 in 0.341s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:02 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c Sep 01 02:25:02 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:02 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9.1a4c8777-aba8-4e6f-a6c3-0708192eb18c" returned: 0 in 0.289s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-1a4c8777-aba8-4e6f-a6c3-0708192eb18c" released by "_delete_snapshot" :: held 1.936s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" released by "delete_snapshot" :: held 1.968s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Created reservations ['dbe37a91-0875-4c66-b5b5-fcdbe8900c51', '5e98efab-b555-4e90-8fe5-3af1218ef438', 'faf4e1ff-5978-4a51-aabe-744cde2afc3d', '5a84a547-229e-43f1-b9e4-6ab06f0703d8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Delete snapshot completed successfully. Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f97e0088-7224-4eba-ac0d-b25412ff6047 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-1a4c8777-aba8-4e6f-a6c3-0708192eb18c-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (3f8bee39-5920-4b85-8b92-dbcc9ebc17f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e083c50-e98b-4e93-a626-4aea5eae4a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e083c50-e98b-4e93-a626-4aea5eae4a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718163981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac744b4-f8a7-402d-9682-9c39cf8e5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:03Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420e2450-31b5-40b1-834c-16839d6cab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420e2450-31b5-40b1-834c-16839d6cab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d0a6f-2d19-4c35-afe6-771076a7d323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d0a6f-2d19-4c35-afe6-771076a7d323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac744b4-f8a7-402d-9682-9c39cf8e5275', 'volume_name': 'volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d0e9d2-c1eb-4688-b8d8-ae1c6799255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:02 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d0e9d2-c1eb-4688-b8d8-ae1c6799255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce64dca-9208-4f0f-9bb0-0b6ebee89496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Volume 3ac744b4-f8a7-402d-9682-9c39cf8e5275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275', 'volume_size': 1} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718163981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac744b4-f8a7-402d-9682-9c39cf8e5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:03Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Creating volume 3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:03 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:03 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 1073741824 Sep 01 02:25:03 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:03 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 1073741824" returned: 0 in 0.500s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:03 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 Sep 01 02:25:03 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-f2d40f5e-005a-433b-b096-ae2fe6a45db9-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-f2d40f5e-005a-433b-b096-ae2fe6a45db9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:03 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275" returned: 0 in 0.370s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce64dca-9208-4f0f-9bb0-0b6ebee89496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3060ffc1-01e7-4068-bf4b-1f506cf963bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e8200-b05d-4504-8021-961bb1e4a3bd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:03 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Volume volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 (3ac744b4-f8a7-402d-9682-9c39cf8e5275): created successfully Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3060ffc1-01e7-4068-bf4b-1f506cf963bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:03 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (3f8bee39-5920-4b85-8b92-dbcc9ebc17f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e9089a6b-7935-471f-afd6-fd9e158f3901 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:04 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 Sep 01 02:25:04 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:04 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9" returned: 0 in 0.420s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:04 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9 Sep 01 02:25:04 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:04 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-f2d40f5e-005a-433b-b096-ae2fe6a45db9" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-f2d40f5e-005a-433b-b096-ae2fe6a45db9" released by "delete_volume" :: held 0.790s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Created reservations ['1702e64f-3602-4564-93a5-ee394c112f7b', '953cc5b9-6ca1-44e7-84a5-9b5545b04236', '0b4d83a3-bfea-47e2-afc5-ab0cc3638e88', '20b3cce2-68af-44cc-86ab-e34d997aabd8'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:04 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:04 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.431s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Deleted volume successfully. Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9988aa15-55cb-49c3-849e-92e2f7eba80b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-f2d40f5e-005a-433b-b096-ae2fe6a45db9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:05 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (4995b811-5f8c-444e-b374-e4b13b6a398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8352fda-4970-41be-b610-96f6a9562fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8352fda-4970-41be-b610-96f6a9562fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669670900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6298ac-25c9-46d2-a049-e2d1d0bc6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:06Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec7bc57-7fbe-48c0-8a0b-b1e0d557bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec7bc57-7fbe-48c0-8a0b-b1e0d557bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e0e995-cb68-4f29-aeb9-60e23f02e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e0e995-cb68-4f29-aeb9-60e23f02e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6298ac-25c9-46d2-a049-e2d1d0bc6336', 'volume_name': 'volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d46975d-2d19-43cc-bcd0-d9f390ab8925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d46975d-2d19-43cc-bcd0-d9f390ab8925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8fc95-c776-4336-8368-444f9a1a48c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Volume 4e6298ac-25c9-46d2-a049-e2d1d0bc6336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336', 'volume_size': 1} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669670900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6298ac-25c9-46d2-a049-e2d1d0bc6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:06Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Creating volume 4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:05 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:05 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 1073741824 Sep 01 02:25:05 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-aecdbf42-dbf2-495a-b7fe-086b545d802c tempest-ProjectAdminTests-1126436808 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.039436340332, 'free_capacity_gb': 1774.039436340332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86925) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:25:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:06 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 1073741824" returned: 0 in 0.566s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:06 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 Sep 01 02:25:06 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:06 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" returned: 0 in 0.283s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.824s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Creating offline snapshot 4526f61b-fd65-4ea0-897c-33c841a0302a of volume 3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8fc95-c776-4336-8368-444f9a1a48c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714a1528-5ad4-400f-abfb-0cb513677c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[711cb291-3a4e-4dac-9ab8-1c125ca521f3]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:06 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Volume volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 (4e6298ac-25c9-46d2-a049-e2d1d0bc6336): created successfully Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714a1528-5ad4-400f-abfb-0cb513677c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:06 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (4995b811-5f8c-444e-b374-e4b13b6a398c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:06 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-641c6f0a-6e31-419b-9c9e-f678a614559a tempest-ProjectReaderTests-1632631066 None] Created volume successfully. Sep 01 02:25:06 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 Sep 01 02:25:06 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:07 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275" returned: 0 in 0.437s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:07 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a 1G Sep 01 02:25:07 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:07 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a 1G" returned: 0 in 0.496s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:07 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a Sep 01 02:25:07 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:08 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a" returned: 0 in 0.329s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:08 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a is being set with open permissions: ugo+rw Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:08 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a Sep 01 02:25:08 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:08 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a" returned: 0 in 0.299s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:UPDATE=303,cinder:SELECT=251,cinder:DELETE=35,cinder:INSERT=78 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=221,cinder:UPDATE=338,cinder:INSERT=93,cinder:DELETE=22 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:08 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info Sep 01 02:25:08 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:08 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:08 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info is being set with open permissions: ugo+rw Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:08 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info Sep 01 02:25:08 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:08 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.info" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.702s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:08 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Creating offline snapshot 8edfdbbf-0db0-47a6-995d-6f9c86544151 of volume 4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:09 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9129fd43-8663-4340-aad7-20f26910841e tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a338a-98cc-4084-95f8-916f9f1bb810]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:09 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 Sep 01 02:25:09 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:09 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:09 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 1G Sep 01 02:25:09 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:09 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 1G" returned: 0 in 0.461s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:09 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 Sep 01 02:25:09 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-4526f61b-fd65-4ea0-897c-33c841a0302a-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-4526f61b-fd65-4ea0-897c-33c841a0302a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-4526f61b-fd65-4ea0-897c-33c841a0302a" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-4526f61b-fd65-4ea0-897c-33c841a0302a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:10 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot 4526f61b-fd65-4ea0-897c-33c841a0302a of volume 3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151" returned: 0 in 0.400s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:10 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 is being set with open permissions: ugo+rw Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8189fe4c-a2ac-43e8-960c-e80057ec4622]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:10 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 Sep 01 02:25:10 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:10 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a Sep 01 02:25:10 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:10 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151" returned: 0 in 0.384s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:10 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a" returned: 0 in 0.435s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:10 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info Sep 01 02:25:10 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe688f4-7e9f-4c22-9339-53914722c72f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:10 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 Sep 01 02:25:10 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:11 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info" returned: 0 in 0.343s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:11 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info is being set with open permissions: ugo+rw Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:11 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info Sep 01 02:25:11 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:11 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:11 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a Sep 01 02:25:11 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:11 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.info" returned: 0 in 0.330s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a94e9ef9-751a-4759-9239-63dc96a67a1d tempest-ProjectReaderTests-1632631066 None] Create snapshot completed successfully Sep 01 02:25:11 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a" returned: 0 in 0.386s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:11 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a Sep 01 02:25:11 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:11 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275.4526f61b-fd65-4ea0-897c-33c841a0302a" returned: 0 in 0.289s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-4526f61b-fd65-4ea0-897c-33c841a0302a" released by "_delete_snapshot" :: held 1.693s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" released by "delete_snapshot" :: held 1.729s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Created reservations ['434b50d4-fb23-4d52-8cb0-9375f5f86ab6', '94e82431-90dc-4d26-b79c-73ce834aa3a3', '5123d2cf-83bf-4e9d-8ede-b0a77226acf3', '2c997a91-6e45-4683-a4e3-cc94dd4a61da'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8f9dd724-5ef7-4b83-90f1-892606857905 tempest-ProjectMemberTests-825061873 None] Lock "cinder-4526f61b-fd65-4ea0-897c-33c841a0302a-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-3ac744b4-f8a7-402d-9682-9c39cf8e5275-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "cinder-3ac744b4-f8a7-402d-9682-9c39cf8e5275-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f625a5-9379-41a3-b6a4-99e5705be0a9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-8edfdbbf-0db0-47a6-995d-6f9c86544151-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-8edfdbbf-0db0-47a6-995d-6f9c86544151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-8edfdbbf-0db0-47a6-995d-6f9c86544151" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-8edfdbbf-0db0-47a6-995d-6f9c86544151" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:12 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 Sep 01 02:25:12 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Deleting offline snapshot 8edfdbbf-0db0-47a6-995d-6f9c86544151 of volume 4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] snapshot_file for this snap is: volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced93b5-c9d4-49ab-b084-86758ec505ed]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (64e8fb5a-60e0-4ebf-ba3d-d0034079a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201a916c-d456-467f-9857-8cb5b420a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201a916c-d456-467f-9857-8cb5b420a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092823704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151d1fcf-5097-412b-9104-5ed47dd829a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:13Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:12 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 Sep 01 02:25:12 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf261bb-6a3d-42e3-94c9-1dd471878b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf261bb-6a3d-42e3-94c9-1dd471878b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f8d367-7137-4805-b693-4cb1cada2e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:12 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f8d367-7137-4805-b693-4cb1cada2e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151d1fcf-5097-412b-9104-5ed47dd829a3', 'volume_name': 'volume-151d1fcf-5097-412b-9104-5ed47dd829a3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16de67cf-a477-42de-b679-f6edc796f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16de67cf-a477-42de-b679-f6edc796f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17512606-eb24-4939-97a8-d25ee1a75d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Volume 151d1fcf-5097-412b-9104-5ed47dd829a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151d1fcf-5097-412b-9104-5ed47dd829a3', 'volume_size': 1} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092823704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151d1fcf-5097-412b-9104-5ed47dd829a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:13Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Creating volume 151d1fcf-5097-412b-9104-5ed47dd829a3 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:13 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:13 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275" returned: 0 in 0.487s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 1073741824 Sep 01 02:25:13 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275 Sep 01 02:25:13 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151" returned: 0 in 0.471s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a53d8-8843-41ac-9613-10161a7e9852]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-3ac744b4-f8a7-402d-9682-9c39cf8e5275" returned: 0 in 0.306s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-3ac744b4-f8a7-402d-9682-9c39cf8e5275" released by "delete_volume" :: held 0.889s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:13 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 Sep 01 02:25:13 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Created reservations ['0e4de9e8-ca9e-4538-a828-fd87dbfab8cf', '27ce396b-dbc4-49de-a5de-bd12c7ca8668', '4c3c13c1-8f82-417b-88fb-ac038c6f62de', 'c42dc0f7-e763-41bc-8ac3-12239fc9c7d1'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:13 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 1073741824" returned: 0 in 0.620s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 Sep 01 02:25:13 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" returned: 0 in 0.536s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:13 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 Sep 01 02:25:13 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:13 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.388s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:13 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-495823b3-aa0a-4bfb-a547-a94a1fc8ee16 tempest-ProjectMemberTests-825061873 None] Lock "cinder-3ac744b4-f8a7-402d-9682-9c39cf8e5275-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:14 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17512606-eb24-4939-97a8-d25ee1a75d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151d1fcf-5097-412b-9104-5ed47dd829a3', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bb31d6-2d66-47ef-9da3-c26850433963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Volume volume-151d1fcf-5097-412b-9104-5ed47dd829a3 (151d1fcf-5097-412b-9104-5ed47dd829a3): created successfully Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bb31d6-2d66-47ef-9da3-c26850433963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (64e8fb5a-60e0-4ebf-ba3d-d0034079a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6d44647d-cc54-469f-98f1-0b3791b83abf tempest-ProjectReaderTests-1779574691 None] Created volume successfully. Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (c7de383e-13f8-4814-8154-a775fa398e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d0636-4b44-4ca0-9a6b-1e3e16dff354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d0636-4b44-4ca0-9a6b-1e3e16dff354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030199314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:14Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb001993-30ff-40a2-a2cd-e60bfa19c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb001993-30ff-40a2-a2cd-e60bfa19c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd64f9-d922-430a-a550-21f500110982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd64f9-d922-430a-a550-21f500110982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91', 'volume_name': 'volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a76a597-2aff-48b8-8e1c-c2871f714a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a76a597-2aff-48b8-8e1c-c2871f714a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d14a3ec-056c-47a9-b50d-b1ba7fe0963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Volume 0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91', 'volume_size': 1} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030199314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:14Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Creating volume 0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:14 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151" returned: 0 in 0.527s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:14 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 1073741824 Sep 01 02:25:14 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:14 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151 Sep 01 02:25:14 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:14 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336.8edfdbbf-0db0-47a6-995d-6f9c86544151" returned: 0 in 0.255s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-8edfdbbf-0db0-47a6-995d-6f9c86544151" released by "_delete_snapshot" :: held 1.921s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" released by "delete_snapshot" :: held 1.947s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Created reservations ['be635721-c571-40bc-8c77-fd26082e5b26', 'd2207e30-2353-4608-93b8-e83bab8a35b0', 'e3156496-ba43-4c19-913c-256b844a33ef', 'd24d5072-b283-4377-878d-c39ae5bbbb27'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Delete snapshot completed successfully. Sep 01 02:25:14 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d806a344-09f1-478d-af42-5bc528027a9b tempest-ProjectReaderTests-1632631066 None] Lock "cinder-8edfdbbf-0db0-47a6-995d-6f9c86544151-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 1073741824" returned: 0 in 0.474s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-4e6298ac-25c9-46d2-a049-e2d1d0bc6336-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-4e6298ac-25c9-46d2-a049-e2d1d0bc6336-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:14 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 Sep 01 02:25:14 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e949776-c7e8-4d12-bc07-201b99597568]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:15 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 Sep 01 02:25:15 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:15 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" returned: 0 in 0.375s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d14a3ec-056c-47a9-b50d-b1ba7fe0963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f013d-0423-4b97-9be4-8b8dd9e1ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:15 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Volume volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 (0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91): created successfully Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f013d-0423-4b97-9be4-8b8dd9e1ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (c7de383e-13f8-4814-8154-a775fa398e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-151d1fcf-5097-412b-9104-5ed47dd829a3-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:15 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-e02ace9c-6d4f-410a-b0ce-23b9fd10bc6b tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "cinder-151d1fcf-5097-412b-9104-5ed47dd829a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-quobyte-151d1fcf-5097-412b-9104-5ed47dd829a3" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-151d1fcf-5097-412b-9104-5ed47dd829a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2208ba-7244-48fa-9e2b-ac918ab50471]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:15 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" returned: 0 in 0.473s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:15 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336 Sep 01 02:25:15 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:15 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 Sep 01 02:25:15 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:15 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-4e6298ac-25c9-46d2-a049-e2d1d0bc6336" released by "delete_volume" :: held 0.821s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Created reservations ['67322c2b-0bc4-4b54-bc23-7337208e40b8', '9ebcc136-413f-4e0b-bba1-a18f731cd697', '1a432c19-04fd-4081-90c5-6683cbb4f3fc', '8042a559-6d4f-4be5-8c85-19280ca52cae'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:15 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3" returned: 0 in 0.400s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:15 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3 Sep 01 02:25:15 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:15 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:15 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:16 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-151d1fcf-5097-412b-9104-5ed47dd829a3" returned: 0 in 0.307s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-151d1fcf-5097-412b-9104-5ed47dd829a3" released by "delete_volume" :: held 0.759s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:16 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.301s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Deleted volume successfully. Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-97c45f17-ae1b-4b0b-858a-253072b1ed08 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-4e6298ac-25c9-46d2-a049-e2d1d0bc6336-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Created reservations ['33e1cdc9-adc8-4411-9932-c3fc12dee909', '061fc471-c1f6-42a6-b058-5adabe10446e', '9eb1ad25-e2ce-4732-b2a3-9dd6ae092b0c', '521d8420-9111-42f0-bd3c-fee3d90a8b90'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:16 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:16 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:16 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.319s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:16 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Deleted volume successfully. Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (3c7a52c1-05be-4c99-b915-6accfb3bbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a20ff-5e1f-43ff-a241-6414964b3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a20ff-5e1f-43ff-a241-6414964b3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133334462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551ef4c-c357-4d07-a917-84c6c7a98f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:17Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e1f127-2403-4d0c-9ee1-5098d5c3f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e1f127-2403-4d0c-9ee1-5098d5c3f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c363ca5-d12f-48ca-91e1-0e1f017956fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c363ca5-d12f-48ca-91e1-0e1f017956fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6551ef4c-c357-4d07-a917-84c6c7a98f7f', 'volume_name': 'volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27efc12c-4cf4-4c52-9e17-9c4087fdcf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27efc12c-4cf4-4c52-9e17-9c4087fdcf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05ae044-b1bd-4dde-9b73-31102ad6549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:16 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Volume 6551ef4c-c357-4d07-a917-84c6c7a98f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f', 'volume_size': 1} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133334462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551ef4c-c357-4d07-a917-84c6c7a98f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:17Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Creating volume 6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:16 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:16 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-4c35112b-3d47-48de-b8c6-fe409d5eb63f tempest-ProjectReaderTests-1779574691 None] Lock "cinder-151d1fcf-5097-412b-9104-5ed47dd829a3-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:16 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f 1073741824 Sep 01 02:25:16 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (1bbcaf1b-9553-48d3-b417-b3103035e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527f666-3fc4-4e99-b62b-eca446ef0d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527f666-3fc4-4e99-b62b-eca446ef0d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109383133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94d6435-94e3-44b2-913d-ced8c5daadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:17Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af1c1e2-fc72-4bb3-b19b-787d78f93bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af1c1e2-fc72-4bb3-b19b-787d78f93bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d3391-df6a-4bd0-a9e5-20bb537f27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d3391-df6a-4bd0-a9e5-20bb537f27b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94d6435-94e3-44b2-913d-ced8c5daadfa', 'volume_name': 'volume-b94d6435-94e3-44b2-913d-ced8c5daadfa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba68282-c71a-42e2-8ade-8945ed467ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba68282-c71a-42e2-8ade-8945ed467ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4377691e-c24f-4e22-aba0-a301c774ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Volume b94d6435-94e3-44b2-913d-ced8c5daadfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94d6435-94e3-44b2-913d-ced8c5daadfa', 'volume_size': 1} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:17 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f 1073741824" returned: 0 in 0.474s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:17 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f Sep 01 02:25:17 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:17 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f" returned: 0 in 0.289s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Creating offline snapshot ac8a7d79-9915-4823-b479-a3924b1a5a57 of volume 0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05ae044-b1bd-4dde-9b73-31102ad6549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4d3976-3426-4f10-b367-7615201925b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[607641d6-9273-4243-b882-061ed728242e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:17 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Volume volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f (6551ef4c-c357-4d07-a917-84c6c7a98f7f): created successfully Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4d3976-3426-4f10-b367-7615201925b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:17 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (3c7a52c1-05be-4c99-b915-6accfb3bbb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:17 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ddf74660-8537-4b3b-b012-05b21acb8609 tempest-ProjectReaderTests-1632631066 None] Created volume successfully. Sep 01 02:25:17 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 Sep 01 02:25:17 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:18 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:18 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 1G Sep 01 02:25:18 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:18 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 1G" returned: 0 in 0.416s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:18 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 Sep 01 02:25:18 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:18 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57" returned: 0 in 0.405s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:18 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 is being set with open permissions: ugo+rw Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:18 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:18 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 Sep 01 02:25:18 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:19 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57" returned: 0 in 0.263s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:19 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info Sep 01 02:25:19 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:19 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:19 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info is being set with open permissions: ugo+rw Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:19 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info Sep 01 02:25:19 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:19 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.info" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.449s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109383133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94d6435-94e3-44b2-913d-ced8c5daadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:17Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Creating volume b94d6435-94e3-44b2-913d-ced8c5daadfa {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:19 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:19 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa 1073741824 Sep 01 02:25:19 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-42442dbd-aac4-4f8b-8782-35ad4542291d tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:20 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa 1073741824" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:20 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa Sep 01 02:25:20 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:20 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.433s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4377691e-c24f-4e22-aba0-a301c774ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94d6435-94e3-44b2-913d-ced8c5daadfa', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bac94c-7321-482b-b950-69dea01978a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Creating offline snapshot c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 of volume 6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:20 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Volume volume-b94d6435-94e3-44b2-913d-ced8c5daadfa (b94d6435-94e3-44b2-913d-ced8c5daadfa): created successfully Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bac94c-7321-482b-b950-69dea01978a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (1bbcaf1b-9553-48d3-b417-b3103035e52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dac85a-f583-402d-bc8a-3dfb783043ee]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:20 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-385c1c0f-44b8-4a0d-be90-5ca0285afc20 tempest-ProjectReaderTests-1779574691 None] Created volume successfully. Sep 01 02:25:20 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f Sep 01 02:25:20 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:20 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f" returned: 0 in 0.357s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:20 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 1G Sep 01 02:25:20 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-ac8a7d79-9915-4823-b479-a3924b1a5a57-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-ac8a7d79-9915-4823-b479-a3924b1a5a57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-ac8a7d79-9915-4823-b479-a3924b1a5a57" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-ac8a7d79-9915-4823-b479-a3924b1a5a57" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot ac8a7d79-9915-4823-b479-a3924b1a5a57 of volume 0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7e94e5-d47a-4fb6-bff4-ce34e68e1064]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 Sep 01 02:25:21 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 1G" returned: 0 in 0.389s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 Sep 01 02:25:21 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4314c-243f-4f8a-8e55-75d95167252e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-b94d6435-94e3-44b2-913d-ced8c5daadfa-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "cinder-b94d6435-94e3-44b2-913d-ced8c5daadfa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-quobyte-b94d6435-94e3-44b2-913d-ced8c5daadfa" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:21 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 Sep 01 02:25:21 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-b94d6435-94e3-44b2-913d-ced8c5daadfa" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[16516a37-83cb-4431-8456-98b4d3968a8c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" returned: 0 in 0.342s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 is being set with open permissions: ugo+rw Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 Sep 01 02:25:21 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa Sep 01 02:25:21 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" returned: 0 in 0.393s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 Sep 01 02:25:21 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info Sep 01 02:25:21 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:21 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:21 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa Sep 01 02:25:21 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:22 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info is being set with open permissions: ugo+rw Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:22 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info Sep 01 02:25:22 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:22 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57 Sep 01 02:25:22 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:22 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b94d6435-94e3-44b2-913d-ced8c5daadfa" returned: 0 in 0.278s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-b94d6435-94e3-44b2-913d-ced8c5daadfa" released by "delete_volume" :: held 0.694s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Created reservations ['7f573688-3e13-4065-8131-fa3e3b5264ef', '12dcda2f-e9db-455d-8314-689ea89e53bd', '3fba5a05-1dc3-43f8-bf14-ded1ab6de4b5', 'd2c20c3a-a791-4fc9-8ecd-9b345f3a4999'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:22 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:22 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:22 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.info" returned: 0 in 0.277s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91.ac8a7d79-9915-4823-b479-a3924b1a5a57" returned: 0 in 0.278s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-ac8a7d79-9915-4823-b479-a3924b1a5a57" released by "_delete_snapshot" :: held 1.559s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-1df2660e-0344-4d57-8efc-556d431c26a4 tempest-ProjectReaderTests-1632631066 None] Create snapshot completed successfully Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" released by "delete_snapshot" :: held 1.586s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Created reservations ['3ecfb440-89d1-4d16-9ae7-d4c16a90f9de', '7cf9b322-724b-42e3-a6e5-fd357e6dd112', '68e06d9b-4aea-4c3d-818b-3e978a7361f0', '792083eb-b2d2-440f-987e-ae402dc8cfc6'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:22 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.270s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:22 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Deleted volume successfully. Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-0e195c5f-bd84-473b-b615-b52a50165729 tempest-ProjectMemberTests-825061873 None] Lock "cinder-ac8a7d79-9915-4823-b479-a3924b1a5a57-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-f8689ddf-3aa3-41d8-8e7f-95bd602d0f8a tempest-ProjectReaderTests-1779574691 None] Lock "cinder-b94d6435-94e3-44b2-913d-ced8c5daadfa-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (83d40071-7c08-49e6-8443-0a07b10a73f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299cc6c-b564-44e6-b1af-dbf240e2a3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299cc6c-b564-44e6-b1af-dbf240e2a3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878620651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ffac63-3670-4b94-80bc-08dad3bd0446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:23Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72181dce-2945-4576-b3fe-1d15ccc9addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72181dce-2945-4576-b3fe-1d15ccc9addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48414c10-cb32-4117-bf93-741ebdfd7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48414c10-cb32-4117-bf93-741ebdfd7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ffac63-3670-4b94-80bc-08dad3bd0446', 'volume_name': 'volume-05ffac63-3670-4b94-80bc-08dad3bd0446', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54988fc5-2d2a-4a4b-b2b4-0bc774f47d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54988fc5-2d2a-4a4b-b2b4-0bc774f47d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22228b7e-f31e-4b1e-a5f3-85ed69b65fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Volume 05ffac63-3670-4b94-80bc-08dad3bd0446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ffac63-3670-4b94-80bc-08dad3bd0446', 'volume_size': 1} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878620651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ffac63-3670-4b94-80bc-08dad3bd0446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:23Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Creating volume 05ffac63-3670-4b94-80bc-08dad3bd0446 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:23 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:23 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 1073741824 Sep 01 02:25:23 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "cinder-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Deleting offline snapshot c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 of volume 6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] snapshot_file for this snap is: volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" acquired by "delete_volume" :: waited 0.036s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96c5889-636a-4a39-82af-b6aca4d00573]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fada6c0-f6c4-49af-9d14-a6d78762c338]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 Sep 01 02:25:23 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 Sep 01 02:25:23 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 1073741824" returned: 0 in 0.465s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 Sep 01 02:25:23 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" returned: 0 in 0.400s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:23 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" returned: 0 in 0.412s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522745a-d453-4db8-97ea-ffd0d36dc026]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:23 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91 Sep 01 02:25:23 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f Sep 01 02:25:23 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:23 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446" returned: 0 in 0.266s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22228b7e-f31e-4b1e-a5f3-85ed69b65fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ffac63-3670-4b94-80bc-08dad3bd0446', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a569e-8f4f-467c-a38e-1b328a92d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:23 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Volume volume-05ffac63-3670-4b94-80bc-08dad3bd0446 (05ffac63-3670-4b94-80bc-08dad3bd0446): created successfully Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a569e-8f4f-467c-a38e-1b328a92d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (83d40071-7c08-49e6-8443-0a07b10a73f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3bc5d035-24aa-4124-bcd3-138091a06361 tempest-ProjectReaderTests-1779574691 None] Created volume successfully. Sep 01 02:25:23 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91" released by "delete_volume" :: held 0.749s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Created reservations ['f358f34f-821b-4739-bb96-b00ab9e9450a', '137132ec-847b-4f40-8902-d23785325133', 'bfb23dd5-b95d-461c-9771-aa2a6f1697de', 'e7078260-e6d0-4ef1-8d1a-12d371ddfbd4'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:24 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f" returned: 0 in 0.408s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:24 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:24 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:24 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 Sep 01 02:25:24 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:24 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.275s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-52833889-284a-4aa0-81cc-e7b722def112 tempest-ProjectMemberTests-825061873 None] Lock "cinder-0dfb2ab6-83b7-4ad6-902a-a0b56dc1fa91-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:24 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" returned: 0 in 0.354s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:24 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0 Sep 01 02:25:24 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (53551229-a031-4e94-83ae-4b3fc6420bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e0190-d496-4944-b571-5deb2d4d7ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e0190-d496-4944-b571-5deb2d4d7ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238809254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedd79a3-9b16-433c-b5cd-137f3f6fffba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:25Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b908f0-03fd-4c78-a709-59b3a364eea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b908f0-03fd-4c78-a709-59b3a364eea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8ff8e4-dee7-4d5d-8412-bb57a810bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8ff8e4-dee7-4d5d-8412-bb57a810bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedd79a3-9b16-433c-b5cd-137f3f6fffba', 'volume_name': 'volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c5d099-123c-4c4d-9d55-9f5d6b0d7782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:24 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c5d099-123c-4c4d-9d55-9f5d6b0d7782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a46e93-5201-4759-a49f-cfe7d9d676d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:24 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Volume fedd79a3-9b16-433c-b5cd-137f3f6fffba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba', 'volume_size': 1} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238809254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedd79a3-9b16-433c-b5cd-137f3f6fffba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:25Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Creating volume fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:24 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f.c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" returned: 0 in 0.306s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:24 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba 1073741824 Sep 01 02:25:24 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0" released by "_delete_snapshot" :: held 1.607s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" released by "delete_snapshot" :: held 1.638s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Created reservations ['08b8c50c-5e59-4b62-8905-5f08dab120fc', 'cf62b0d9-f16d-4006-a8ce-14f634bcabec', 'f155016f-0c62-4845-ae04-62d76660da83', '6da57536-ece0-494a-bc86-d3687560d945'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Delete snapshot completed successfully. Sep 01 02:25:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-a4ffd63e-54cc-4ce9-b68d-473e7da7d7be tempest-ProjectReaderTests-1632631066 None] Lock "cinder-c1e17374-6bd9-4cd0-a38a-3bdbf7d355a0-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-05ffac63-3670-4b94-80bc-08dad3bd0446-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-05ffac63-3670-4b94-80bc-08dad3bd0446-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-quobyte-05ffac63-3670-4b94-80bc-08dad3bd0446" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-05ffac63-3670-4b94-80bc-08dad3bd0446" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba38b1b7-f96c-4305-81f5-1f2c73af9ae6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:25 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba 1073741824" returned: 0 in 0.491s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-6551ef4c-c357-4d07-a917-84c6c7a98f7f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:25 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 Sep 01 02:25:25 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba Sep 01 02:25:25 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:25 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-6551ef4c-c357-4d07-a917-84c6c7a98f7f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8dc56-a1ae-4425-8c93-4232963ce796]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:25 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:25 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f Sep 01 02:25:25 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a46e93-5201-4759-a49f-cfe7d9d676d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:25 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576f0e1e-e0e6-46e3-b6ce-678e78cb04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446" returned: 0 in 0.424s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:25 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Volume volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba (fedd79a3-9b16-433c-b5cd-137f3f6fffba): created successfully Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576f0e1e-e0e6-46e3-b6ce-678e78cb04ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:25 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446 Sep 01 02:25:25 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (53551229-a031-4e94-83ae-4b3fc6420bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bed8416a-4ff7-4c2b-87a7-885782528793 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:25 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f" returned: 0 in 0.374s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:25 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f Sep 01 02:25:25 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:25 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-05ffac63-3670-4b94-80bc-08dad3bd0446" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-05ffac63-3670-4b94-80bc-08dad3bd0446" released by "delete_volume" :: held 0.713s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Created reservations ['29c72a64-91cc-4055-80c1-14e18f138c0c', '81fb54bf-8860-46ef-a223-7db15223c5ec', 'acf463f0-f2f4-4bd1-8d2b-49b1da3d87dd', 'a04426a4-b5e9-46b4-b078-8e8d3aefa2de'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:26 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:26 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:26 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-6551ef4c-c357-4d07-a917-84c6c7a98f7f" returned: 0 in 0.245s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-6551ef4c-c357-4d07-a917-84c6c7a98f7f" released by "delete_volume" :: held 0.684s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Created reservations ['ab444478-4e1c-4aba-be2f-434436ec3b41', 'c2374d8e-e137-4243-82b9-733064114a90', 'bd4e241f-d1b0-4d5e-a790-c77c35d70f9b', 'a12eeb1e-5e85-4fc1-99bc-356b5fa9c60a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:26 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:26 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:26 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Deleted volume successfully. Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8bc17b66-42e9-4b81-8e2c-b77b441c87c0 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-05ffac63-3670-4b94-80bc-08dad3bd0446-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:26 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.260s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:26 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Deleted volume successfully. Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c7d97377-34f3-41fa-8650-8b26f7c9d7b5 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-6551ef4c-c357-4d07-a917-84c6c7a98f7f-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (065fd7db-db18-4ecb-810c-f2ea46d7bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7915a-c232-4478-b142-4268c9c5c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7915a-c232-4478-b142-4268c9c5c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484513942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee97be8-b311-48a4-a91f-3a66f52fa616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:27Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0cf179-5c37-4ea5-b703-0fbca5751a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0cf179-5c37-4ea5-b703-0fbca5751a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd09da6d-edc4-4cc2-9574-94fb5e9564ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd09da6d-edc4-4cc2-9574-94fb5e9564ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee97be8-b311-48a4-a91f-3a66f52fa616', 'volume_name': 'volume-0ee97be8-b311-48a4-a91f-3a66f52fa616', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e9c2e-dab5-470c-a979-7a5cf309860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e9c2e-dab5-470c-a979-7a5cf309860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c26e0fa-21a5-457c-9d29-1ac3ad3eb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:26 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Volume 0ee97be8-b311-48a4-a91f-3a66f52fa616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee97be8-b311-48a4-a91f-3a66f52fa616', 'volume_size': 1} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484513942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee97be8-b311-48a4-a91f-3a66f52fa616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1298122f8f49a8813036ad68a7b328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:27Z,use_quota=True,user_id='9388f48110134c6d9cc80e92368c5aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Creating volume 0ee97be8-b311-48a4-a91f-3a66f52fa616 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:26 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:26 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:26 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 1073741824 Sep 01 02:25:26 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (371781be-43b6-451a-b8b3-b7463f81c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17267164-ee5d-47bc-be2a-c4ec2443443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17267164-ee5d-47bc-be2a-c4ec2443443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58685559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde479b8-ee79-4982-80ac-a0a39ebc3a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:27Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50713b5d-641f-497e-98c4-425bd1467e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50713b5d-641f-497e-98c4-425bd1467e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff08812-a755-496b-9738-7ade68d842b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff08812-a755-496b-9738-7ade68d842b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde479b8-ee79-4982-80ac-a0a39ebc3a39', 'volume_name': 'volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc74c42-25c6-4609-b6bb-47b38e0a3b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc74c42-25c6-4609-b6bb-47b38e0a3b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf2ce8f-a720-49d1-8567-27bbb7e63db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Volume bde479b8-ee79-4982-80ac-a0a39ebc3a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39', 'volume_size': 1} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:27 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 1073741824" returned: 0 in 0.429s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:27 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 Sep 01 02:25:27 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:27 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616" returned: 0 in 0.249s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.466s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c26e0fa-21a5-457c-9d29-1ac3ad3eb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee97be8-b311-48a4-a91f-3a66f52fa616', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977dce78-8be0-408c-a90d-a8ffc984b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Creating offline snapshot bc3a6d6a-2bf0-4668-a851-61fc080e5c2c of volume fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:27 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Volume volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 (0ee97be8-b311-48a4-a91f-3a66f52fa616): created successfully Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977dce78-8be0-408c-a90d-a8ffc984b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Flow 'volume_create_manager' (065fd7db-db18-4ecb-810c-f2ea46d7bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[999288ff-4d9e-4c26-8b83-04dfe0066f22]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:27 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:27 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d6f9fef2-ed34-43f5-9802-b74a33c4b2d8 tempest-ProjectReaderTests-1779574691 None] Created volume successfully. Sep 01 02:25:27 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba Sep 01 02:25:27 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:28 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:28 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c 1G Sep 01 02:25:28 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:28 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c 1G" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:28 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c Sep 01 02:25:28 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:28 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" returned: 0 in 0.271s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:28 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c is being set with open permissions: ugo+rw Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:28 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c Sep 01 02:25:28 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-0ee97be8-b311-48a4-a91f-3a66f52fa616-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-0ee97be8-b311-48a4-a91f-3a66f52fa616-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:28 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "cinder-quobyte-0ee97be8-b311-48a4-a91f-3a66f52fa616" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-0ee97be8-b311-48a4-a91f-3a66f52fa616" acquired by "delete_volume" :: waited 0.031s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:28 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info Sep 01 02:25:28 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e9e2c-1eb4-400e-a6d5-2db2524f1c68]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:28 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 Sep 01 02:25:29 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info" returned: 0 in 0.259s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:29 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info is being set with open permissions: ugo+rw Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info Sep 01 02:25:29 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616 Sep 01 02:25:29 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.info" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.270s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58685559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde479b8-ee79-4982-80ac-a0a39ebc3a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e6dfa27bbd446792ade230141cbe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:27Z,use_quota=True,user_id='c9f11e6359e9437ebc6055eb4c172bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Creating volume bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:29 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 1073741824 Sep 01 02:25:29 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d2f77747-8c31-4eb9-bea3-b1de711bb8cf tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:29 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-0ee97be8-b311-48a4-a91f-3a66f52fa616" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-quobyte-0ee97be8-b311-48a4-a91f-3a66f52fa616" released by "delete_volume" :: held 0.662s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Created reservations ['c44e3b83-bd54-407a-8666-f649bdb8d0c0', '3906ef53-7999-40ca-9099-18fc87c47301', 'bf68265a-2538-4a32-81a6-e4354ff1afb8', '7e7ef2ae-2f56-4b6b-873a-60367d329ca3'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:29 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 1073741824" returned: 0 in 0.418s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:29 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:29 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 Sep 01 02:25:29 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:29 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.262s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Deleted volume successfully. Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-3e7a9b35-804c-4a75-9673-7e249e82f132 tempest-ProjectReaderTests-1779574691 None] Lock "cinder-0ee97be8-b311-48a4-a91f-3a66f52fa616-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:30 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39" returned: 0 in 0.297s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf2ce8f-a720-49d1-8567-27bbb7e63db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04c760c-e2ce-4bd2-885b-3fdce48e0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot bc3a6d6a-2bf0-4668-a851-61fc080e5c2c of volume fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868bc3e-fd63-482a-a06d-fd5104fbea1c]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:30 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Volume volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 (bde479b8-ee79-4982-80ac-a0a39ebc3a39): created successfully Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04c760c-e2ce-4bd2-885b-3fdce48e0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Flow 'volume_create_manager' (371781be-43b6-451a-b8b3-b7463f81c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:30 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-af4e697b-576c-403d-b875-5b6d324fd919 tempest-ProjectReaderTests-1632631066 None] Created volume successfully. Sep 01 02:25:30 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c Sep 01 02:25:30 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:30 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[08734a8f-b932-4914-bcfa-47b4140e6875]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:30 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:30 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba Sep 01 02:25:30 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:31 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba" returned: 0 in 0.372s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:31 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c Sep 01 02:25:31 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Creating offline snapshot cfae1b14-f040-4ce5-b832-451e980b026b of volume bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1fbb3f-40c2-4c2a-92ef-ac3a2f148943]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:31 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" returned: 0 in 0.422s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:31 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c Sep 01 02:25:31 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:31 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 Sep 01 02:25:31 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:31 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba.bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" returned: 0 in 0.286s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c" released by "_delete_snapshot" :: held 1.572s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" released by "delete_snapshot" :: held 1.604s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:31 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39" returned: 0 in 0.413s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:31 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b 1G Sep 01 02:25:31 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:31 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Created reservations ['dcdf6659-b7fe-430c-9147-37cbf331b843', 'f11d78a6-d160-4727-a954-ad50cb4eeb7d', '0dda7a78-aa5a-4d91-9a05-2e80d632aa04', 'f60b4433-c41c-4ff7-a2e2-02defd30b1f1'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:32 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-6287c78f-12f6-4c0c-8a40-baecbfb087af tempest-ProjectMemberTests-825061873 None] Lock "cinder-bc3a6d6a-2bf0-4668-a851-61fc080e5c2c-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:32 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b 1G" returned: 0 in 0.385s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:32 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b Sep 01 02:25:32 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-fedd79a3-9b16-433c-b5cd-137f3f6fffba-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "cinder-fedd79a3-9b16-433c-b5cd-137f3f6fffba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa185c-bd01-4956-ba49-fe7c6da712d5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:32 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b" returned: 0 in 0.283s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:32 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b is being set with open permissions: ugo+rw Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:32 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba Sep 01 02:25:32 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:32 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b Sep 01 02:25:32 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:32 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:32 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba" returned: 0 in 0.358s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:32 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:32 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info Sep 01 02:25:32 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:32 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba Sep 01 02:25:32 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:33 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:33 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info is being set with open permissions: ugo+rw Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:33 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fedd79a3-9b16-433c-b5cd-137f3f6fffba" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:33 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info Sep 01 02:25:33 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fedd79a3-9b16-433c-b5cd-137f3f6fffba" released by "delete_volume" :: held 0.647s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Created reservations ['50fbc30c-a044-4e70-8e58-5bf74f07fe66', '83d9bd1f-b4e6-4f8c-b8c5-63df03bd9fce', '8c7fd3be-67e0-44c6-8825-0831375bad7a', '510efbeb-0a5e-4435-ad1b-f753c4ec3a8f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:33 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:33 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:33 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.info" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ca7c4ddc-2bb0-45ee-a1eb-8bcb19963e61 tempest-ProjectReaderTests-1632631066 None] Create snapshot completed successfully Sep 01 02:25:33 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.261s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:33 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-fa233935-89ee-43d0-a974-50297d419d0f tempest-ProjectMemberTests-825061873 None] Lock "cinder-fedd79a3-9b16-433c-b5cd-137f3f6fffba-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-cfae1b14-f040-4ce5-b832-451e980b026b-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-cfae1b14-f040-4ce5-b832-451e980b026b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-cfae1b14-f040-4ce5-b832-451e980b026b" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-cfae1b14-f040-4ce5-b832-451e980b026b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Deleting offline snapshot cfae1b14-f040-4ce5-b832-451e980b026b of volume bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] snapshot_file for this snap is: volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbfc33-f032-458e-9e8e-b45c3521378f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:33 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b Sep 01 02:25:33 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:33 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (2ca4d173-bb32-446d-b52b-9e756ea6cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f7bf11-0b26-4e37-beb4-d5f9e6fe1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f7bf11-0b26-4e37-beb4-d5f9e6fe1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484905742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df6ae8-8925-4c07-be36-afa6c4441094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:34Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c34db75-ef6b-4b54-abf7-65fad7efc985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c34db75-ef6b-4b54-abf7-65fad7efc985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708f01b2-8a63-416f-ae8c-31ab100100f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708f01b2-8a63-416f-ae8c-31ab100100f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2df6ae8-8925-4c07-be36-afa6c4441094', 'volume_name': 'volume-a2df6ae8-8925-4c07-be36-afa6c4441094', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b428de8b-a8e2-4511-bdc5-ca1c12ea28a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b428de8b-a8e2-4511-bdc5-ca1c12ea28a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf24ca9-7043-41ef-ac20-585a7644bba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Volume a2df6ae8-8925-4c07-be36-afa6c4441094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2df6ae8-8925-4c07-be36-afa6c4441094', 'volume_size': 1} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484905742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df6ae8-8925-4c07-be36-afa6c4441094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:34Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Creating volume a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:34 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b" returned: 0 in 0.417s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:34 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 1073741824 Sep 01 02:25:34 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a1dd18-efb5-4e76-b539-16f1bc81f4ce]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 Sep 01 02:25:34 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39" returned: 0 in 0.372s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b Sep 01 02:25:34 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 1073741824" returned: 0 in 0.441s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 Sep 01 02:25:34 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf24ca9-7043-41ef-ac20-585a7644bba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2df6ae8-8925-4c07-be36-afa6c4441094', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0513a431-065c-47e8-a106-61ff5b026dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Volume volume-a2df6ae8-8925-4c07-be36-afa6c4441094 (a2df6ae8-8925-4c07-be36-afa6c4441094): created successfully Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0513a431-065c-47e8-a106-61ff5b026dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b Sep 01 02:25:34 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (2ca4d173-bb32-446d-b52b-9e756ea6cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:34 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2000f462-1408-4d10-b486-213146dbd939 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:35 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39.cfae1b14-f040-4ce5-b832-451e980b026b" returned: 0 in 0.259s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-cfae1b14-f040-4ce5-b832-451e980b026b" released by "_delete_snapshot" :: held 1.484s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" released by "delete_snapshot" :: held 1.511s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Creating offline snapshot fd956d86-c475-4038-82f9-e1e0f3cfe5b6 of volume a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edafe99-7a91-4860-b655-f212318e5ca8]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Created reservations ['d6b713b3-0697-4513-98d9-175e07a7dd06', 'aa865ced-e6ab-42a1-b939-2dd23973713d', '46dc4169-f7a0-488a-aa88-1757871d4ec8', '6c4d91ad-2665-4c3f-87a3-6b5176ef05ed'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:35 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Delete snapshot completed successfully. Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-467d7537-a5e0-43a9-99f9-014c99043af0 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-cfae1b14-f040-4ce5-b832-451e980b026b-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:35 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 Sep 01 02:25:35 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:35 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094" returned: 0 in 0.345s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 1G Sep 01 02:25:35 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-bde479b8-ee79-4982-80ac-a0a39ebc3a39-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-bde479b8-ee79-4982-80ac-a0a39ebc3a39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[059610f0-4d7a-4f1a-aeaa-82b1d34b8852]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 1G" returned: 0 in 0.412s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:35 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df6ae8-8925-4c07-be36-afa6c4441094 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 Sep 01 02:25:35 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:35 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df6ae8-8925-4c07-be36-afa6c4441094 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 Sep 01 02:25:36 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df6ae8-8925-4c07-be36-afa6c4441094 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6" returned: 0 in 0.291s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 is being set with open permissions: ugo+rw Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39 Sep 01 02:25:36 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 Sep 01 02:25:36 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-bde479b8-ee79-4982-80ac-a0a39ebc3a39" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-quobyte-bde479b8-ee79-4982-80ac-a0a39ebc3a39" released by "delete_volume" :: held 0.656s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info Sep 01 02:25:36 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Created reservations ['2393f9ca-442e-47d6-bc2f-f46b72e1976c', '49ee2a71-445d-4909-9903-ffe5dfc0be8b', '509e68a4-df2a-427b-9aea-7444f0bb17b7', 'cdc373ad-5bac-48fa-b154-631ffb8a6e6a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:36 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info is being set with open permissions: ugo+rw Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info Sep 01 02:25:36 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:36 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Deleted volume successfully. Sep 01 02:25:36 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-142a5193-2d95-4cff-a734-6dfacd0d8d13 tempest-ProjectReaderTests-1632631066 None] Lock "cinder-bde479b8-ee79-4982-80ac-a0a39ebc3a39-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:37 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.info" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:37 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2c10c236-cf71-4593-8a16-7fce423f6638 tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-fd956d86-c475-4038-82f9-e1e0f3cfe5b6-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-fd956d86-c475-4038-82f9-e1e0f3cfe5b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-fd956d86-c475-4038-82f9-e1e0f3cfe5b6" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fd956d86-c475-4038-82f9-e1e0f3cfe5b6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot fd956d86-c475-4038-82f9-e1e0f3cfe5b6 of volume a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4720b5-1cc0-4b4b-872f-b820b29308fa]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:37 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 Sep 01 02:25:37 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:37 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2df6ae8-8925-4c07-be36-afa6c4441094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7bb0d1-bdbf-4d57-b64d-724a96f1472f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:37 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 Sep 01 02:25:37 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:38 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094" returned: 0 in 0.378s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:38 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 Sep 01 02:25:38 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:38 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:38 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6 Sep 01 02:25:38 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:38 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094.fd956d86-c475-4038-82f9-e1e0f3cfe5b6" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-fd956d86-c475-4038-82f9-e1e0f3cfe5b6" released by "_delete_snapshot" :: held 1.438s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" released by "delete_snapshot" :: held 1.459s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Created reservations ['54603527-7ee2-422c-a634-1b909bc1a848', '65785398-236f-412e-9580-95c2572e2246', '2d015b28-34d4-4c0e-9d9a-5ef05640ad16', '32401990-ec0a-4d4a-8ca4-f92a40c7fdcc'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-25eb1e8f-58e5-4fd5-bf02-e2823a252cc6 tempest-ProjectMemberTests-825061873 None] Lock "cinder-fd956d86-c475-4038-82f9-e1e0f3cfe5b6-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-a2df6ae8-8925-4c07-be36-afa6c4441094-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "cinder-a2df6ae8-8925-4c07-be36-afa6c4441094-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd9637-8880-4800-be11-b4ed6bf4a621]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:39 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 Sep 01 02:25:39 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:39 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094" returned: 0 in 0.354s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:39 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094 Sep 01 02:25:39 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:40 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-a2df6ae8-8925-4c07-be36-afa6c4441094" returned: 0 in 0.271s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a2df6ae8-8925-4c07-be36-afa6c4441094" released by "delete_volume" :: held 0.699s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Created reservations ['4ec0e504-2cd5-483a-ab6e-60c4752f807f', '01dca4c4-7bd2-4d87-9922-55b625e500cd', 'f4a7de86-2260-4f98-b8ad-6fe150390359', '9085fa6a-c02b-4e00-aabe-f9209a96321f'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:40 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:40 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:40 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d375e750-3069-4790-a13d-273ec16eb7e5 tempest-ProjectMemberTests-825061873 None] Lock "cinder-a2df6ae8-8925-4c07-be36-afa6c4441094-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:40 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:40 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:41 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (62b14246-f1be-4e26-b9ee-8eb44afe7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f72afb-fdd9-4f03-99c0-efd4666263dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.279s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f72afb-fdd9-4f03-99c0-efd4666263dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014321347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b58640-c8a5-488c-8a8f-912da055ea30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:41Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6379d0-23e8-4ca5-995e-44bb11d06a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6379d0-23e8-4ca5-995e-44bb11d06a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e1aea3-8340-4094-81f8-1c5ec4ff2d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e1aea3-8340-4094-81f8-1c5ec4ff2d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b58640-c8a5-488c-8a8f-912da055ea30', 'volume_name': 'volume-c2b58640-c8a5-488c-8a8f-912da055ea30', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e1b63-cfd5-492c-a1f2-840c0f61dd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e1b63-cfd5-492c-a1f2-840c0f61dd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960cd510-de94-4e17-bdc4-7e69ed0b0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Volume c2b58640-c8a5-488c-8a8f-912da055ea30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b58640-c8a5-488c-8a8f-912da055ea30', 'volume_size': 1} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014321347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b58640-c8a5-488c-8a8f-912da055ea30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:41Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Creating volume c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:41 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:41 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 1073741824 Sep 01 02:25:41 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:41 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 1073741824" returned: 0 in 0.417s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:41 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 Sep 01 02:25:41 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:41 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960cd510-de94-4e17-bdc4-7e69ed0b0764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b58640-c8a5-488c-8a8f-912da055ea30', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5855e-8b6a-4c3b-bb0f-ae1393fc2c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:41 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Volume volume-c2b58640-c8a5-488c-8a8f-912da055ea30 (c2b58640-c8a5-488c-8a8f-912da055ea30): created successfully Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5855e-8b6a-4c3b-bb0f-ae1393fc2c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (62b14246-f1be-4e26-b9ee-8eb44afe7c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:41 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-ad1e27d3-97d7-4269-b3ab-57658423cde5 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Creating offline snapshot e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 of volume c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c95e20-d22b-4d11-9eff-3c37ee8940e0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:43 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 Sep 01 02:25:43 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:43 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:43 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:43 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 1G Sep 01 02:25:43 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 1G" returned: 0 in 0.404s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b58640-c8a5-488c-8a8f-912da055ea30 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b58640-c8a5-488c-8a8f-912da055ea30 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 Sep 01 02:25:44 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b58640-c8a5-488c-8a8f-912da055ea30 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" returned: 0 in 0.311s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 is being set with open permissions: ugo+rw Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 Sep 01 02:25:44 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" returned: 0 in 0.248s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info Sep 01 02:25:44 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info" returned: 0 in 0.266s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info is being set with open permissions: ugo+rw Sep 01 02:25:44 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info Sep 01 02:25:44 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:45 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.info" returned: 0 in 0.251s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:45 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c6ddbfac-100b-45b4-a08a-c954621a03ca tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 of volume c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b127a-06ae-4ec8-9f4d-fb0d4dd535ed]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:45 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 Sep 01 02:25:45 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:45 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2b58640-c8a5-488c-8a8f-912da055ea30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[69957154-2963-4dbe-a899-f901c5f66e77]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:45 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 Sep 01 02:25:46 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30" returned: 0 in 0.367s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 Sep 01 02:25:46 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" returned: 0 in 0.330s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8 Sep 01 02:25:46 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30.e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8" released by "_delete_snapshot" :: held 1.401s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" released by "delete_snapshot" :: held 1.422s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:46 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Created reservations ['fa887bc8-0f03-4c16-a20e-2ba581845566', '241f42b0-cac9-4f30-b909-3c57d5d37bc2', '3643362b-ffbc-4c82-82b9-e040670b1d05', 'a1b125af-db8c-4fc4-91d3-6069020e94c2'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-d70af6e2-efc3-494b-bc3d-e4aa8bd67485 tempest-ProjectMemberTests-825061873 None] Lock "cinder-e6eab654-07bd-4b0b-9b5e-ec6505ed1db8-delete_snapshot" released by "delete_snapshot" :: held 1.561s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-c2b58640-c8a5-488c-8a8f-912da055ea30-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "cinder-c2b58640-c8a5-488c-8a8f-912da055ea30-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" acquired by "delete_volume" :: waited 0.021s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d3336-3c68-4402-912d-973492ad259f]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:47 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 Sep 01 02:25:47 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:48 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30" returned: 0 in 0.358s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:48 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30 Sep 01 02:25:48 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:48 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c2b58640-c8a5-488c-8a8f-912da055ea30" returned: 0 in 0.247s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-c2b58640-c8a5-488c-8a8f-912da055ea30" released by "delete_volume" :: held 0.668s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Created reservations ['33ba0f6e-3585-4738-b59e-0ba7583ecf06', '63b50ea2-7b0c-4c76-a5c5-720cdf713ac1', 'cc62e50a-df59-4c65-b6fb-be04dd13bf0a', 'f9f1b6cf-e387-40ef-bb00-18767f10a843'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:48 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:48 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:48 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:48 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:48 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-49d0b7fa-5e29-4e20-bad1-20d9d803bd2d tempest-ProjectMemberTests-825061873 None] Lock "cinder-c2b58640-c8a5-488c-8a8f-912da055ea30-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (bda9ba2e-1382-45a7-b4b3-4e1d645d73e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493609d7-e3d1-4762-916e-0410997fdd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493609d7-e3d1-4762-916e-0410997fdd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971977926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc81a8b-82b7-4930-9adf-45f60e28797f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:49Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d63597a-1578-4ca4-a11c-25208b124b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d63597a-1578-4ca4-a11c-25208b124b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef1043f-61a6-4b15-85cc-ac42472963e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef1043f-61a6-4b15-85cc-ac42472963e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc81a8b-82b7-4930-9adf-45f60e28797f', 'volume_name': 'volume-afc81a8b-82b7-4930-9adf-45f60e28797f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d138720-228a-4fb3-8eb8-bcfe691dbb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d138720-228a-4fb3-8eb8-bcfe691dbb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a928495-1c46-4a7c-83ac-a4db2c537c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:49 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Volume afc81a8b-82b7-4930-9adf-45f60e28797f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc81a8b-82b7-4930-9adf-45f60e28797f', 'volume_size': 1} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971977926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc81a8b-82b7-4930-9adf-45f60e28797f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:49Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Creating volume afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:49 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:49 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f 1073741824 Sep 01 02:25:49 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:49 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f 1073741824" returned: 0 in 0.427s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:49 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:49 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f Sep 01 02:25:49 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:50 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a928495-1c46-4a7c-83ac-a4db2c537c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc81a8b-82b7-4930-9adf-45f60e28797f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507d1b2c-0924-480c-a9cd-b9c9a21a3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:50 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Volume volume-afc81a8b-82b7-4930-9adf-45f60e28797f (afc81a8b-82b7-4930-9adf-45f60e28797f): created successfully Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507d1b2c-0924-480c-a9cd-b9c9a21a3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (bda9ba2e-1382-45a7-b4b3-4e1d645d73e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:50 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-56416877-94ec-4254-ad57-4aeb4c600653 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Creating offline snapshot 6c2e1974-83a0-476c-a807-f3faf342007a of volume afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ef4a7-91ba-411e-876c-e1f575409775]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:50 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f Sep 01 02:25:50 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:50 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f" returned: 0 in 0.370s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:50 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:50 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a 1G Sep 01 02:25:50 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:51 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a 1G" returned: 0 in 0.408s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc81a8b-82b7-4930-9adf-45f60e28797f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:51 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc81a8b-82b7-4930-9adf-45f60e28797f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a Sep 01 02:25:51 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:51 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc81a8b-82b7-4930-9adf-45f60e28797f -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a" returned: 0 in 0.326s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:51 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a is being set with open permissions: ugo+rw Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:51 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a Sep 01 02:25:51 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:51 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:51 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:51 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info Sep 01 02:25:51 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:52 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:52 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info is being set with open permissions: ugo+rw Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:52 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info Sep 01 02:25:52 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:52 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.info" returned: 0 in 0.257s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:52 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-916350bc-ca16-4255-8baa-eafedcfb2ff6 tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-6c2e1974-83a0-476c-a807-f3faf342007a-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-6c2e1974-83a0-476c-a807-f3faf342007a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-6c2e1974-83a0-476c-a807-f3faf342007a" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-6c2e1974-83a0-476c-a807-f3faf342007a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot 6c2e1974-83a0-476c-a807-f3faf342007a of volume afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[32238e0b-d1ec-46be-a24b-2eec124ff061]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:52 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a Sep 01 02:25:52 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:52 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a" returned: 0 in 0.348s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc81a8b-82b7-4930-9adf-45f60e28797f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da68563-fae0-4b47-9f43-c668fbf99d59]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:53 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f Sep 01 02:25:53 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:53 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f" returned: 0 in 0.376s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:53 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a Sep 01 02:25:53 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:53 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a" returned: 0 in 0.346s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:53 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a Sep 01 02:25:53 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:53 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:53 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f.6c2e1974-83a0-476c-a807-f3faf342007a" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-6c2e1974-83a0-476c-a807-f3faf342007a" released by "_delete_snapshot" :: held 1.416s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" released by "delete_snapshot" :: held 1.440s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Created reservations ['8fd79b23-7b18-454e-a3d0-3f401aa836aa', 'd6ab1ca9-f5ac-4e2f-9d05-92aaa2569dee', 'e49cc48a-2b08-4333-85c0-81560de15cef', 'effec3c8-162a-43f3-9d8b-b54ef6d0af0b'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:54 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-bc8a2c14-c103-47cd-9660-eac7e28d38e7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-6c2e1974-83a0-476c-a807-f3faf342007a-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-afc81a8b-82b7-4930-9adf-45f60e28797f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "cinder-afc81a8b-82b7-4930-9adf-45f60e28797f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d009e47d-0173-46e5-9b8e-6116f40f6f62]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:54 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:54 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f Sep 01 02:25:54 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:55 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f" returned: 0 in 0.451s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:55 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f Sep 01 02:25:55 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:55 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-afc81a8b-82b7-4930-9adf-45f60e28797f" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-afc81a8b-82b7-4930-9adf-45f60e28797f" released by "delete_volume" :: held 0.782s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Created reservations ['5ffd4555-2c66-49a9-bd10-d08af05abffd', '0c1be130-9876-46e7-a2f4-5d7b6eb953fd', '975ff751-24ef-4bb3-b324-cc3acd37da50', '70a82c36-dd04-4199-84ce-8210819beaaf'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:55 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:25:55 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:55 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.256s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:55 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:55 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-5b69f00b-b47a-412c-b15b-5d0190f838d2 tempest-ProjectMemberTests-825061873 None] Lock "cinder-afc81a8b-82b7-4930-9adf-45f60e28797f-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (3604e655-f651-4877-abb4-a2341503023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2ec1be-7bc2-49fa-a007-d4575397bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2ec1be-7bc2-49fa-a007-d4575397bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085275628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5f2553-3d45-431d-8e2c-f70cb5ad7067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:56Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfd877e-77ca-4fd3-8128-8d9378cf7509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfd877e-77ca-4fd3-8128-8d9378cf7509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ad8dcf-a06f-45c1-9b36-11c4fbf2838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ad8dcf-a06f-45c1-9b36-11c4fbf2838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5f2553-3d45-431d-8e2c-f70cb5ad7067', 'volume_name': 'volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919a5fc0-e1ae-47cb-a0f9-168a27c5433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919a5fc0-e1ae-47cb-a0f9-168a27c5433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0623d1f5-8a77-4c18-84df-fb34e6ceed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:56 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Volume 1c5f2553-3d45-431d-8e2c-f70cb5ad7067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067', 'volume_size': 1} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085275628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5f2553-3d45-431d-8e2c-f70cb5ad7067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:56Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Creating volume 1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:56 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:56 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 1073741824 Sep 01 02:25:56 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:56 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 1073741824" returned: 0 in 0.447s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:56 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:57 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 Sep 01 02:25:57 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:57 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0623d1f5-8a77-4c18-84df-fb34e6ceed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f18a9a-6888-4fa5-8af5-209790855250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:57 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Volume volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 (1c5f2553-3d45-431d-8e2c-f70cb5ad7067): created successfully Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f18a9a-6888-4fa5-8af5-209790855250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (3604e655-f651-4877-abb4-a2341503023e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:57 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-2006d928-b7c8-4a9a-940d-f7bbf06ff4f9 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Creating offline snapshot eb562d13-549e-4f22-ba7c-5b8f17154d30 of volume 1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a94d2c-2aad-490b-9364-c0b29afbdf4e]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:57 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:57 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 Sep 01 02:25:57 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:58 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:58 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 1G Sep 01 02:25:58 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:58 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 1G" returned: 0 in 0.395s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:58 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 Sep 01 02:25:58 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:58 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30" returned: 0 in 0.300s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:58 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 is being set with open permissions: ugo+rw Sep 01 02:25:58 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:58 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 Sep 01 02:25:58 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:59 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:59 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info Sep 01 02:25:59 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:59 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info" returned: 0 in 0.295s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:59 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info is being set with open permissions: ugo+rw Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:59 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info Sep 01 02:25:59 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:59 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.info" returned: 0 in 0.275s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:59 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:59 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eba38862-2e98-4696-8ed3-978684487a38 tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-eb562d13-549e-4f22-ba7c-5b8f17154d30-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-eb562d13-549e-4f22-ba7c-5b8f17154d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-eb562d13-549e-4f22-ba7c-5b8f17154d30" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-eb562d13-549e-4f22-ba7c-5b8f17154d30" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot eb562d13-549e-4f22-ba7c-5b8f17154d30 of volume 1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303b361-6702-443a-9706-720c53fd7f55]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:00 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:01 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 Sep 01 02:26:01 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:01 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8fb98b-7ac1-48fe-8f91-d56c04b66d51]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:01 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 Sep 01 02:26:01 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:01 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" returned: 0 in 0.369s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:01 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:01 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 Sep 01 02:26:01 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:02 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30" returned: 0 in 0.368s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:02 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30 Sep 01 02:26:02 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:02 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067.eb562d13-549e-4f22-ba7c-5b8f17154d30" returned: 0 in 0.276s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-eb562d13-549e-4f22-ba7c-5b8f17154d30" released by "_delete_snapshot" :: held 1.505s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" released by "delete_snapshot" :: held 1.529s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Created reservations ['d96fd765-b60e-4fa5-9917-1035f553f72d', '4f18670c-9612-45c2-bf9d-a494e8a4c83e', '6998a54f-d645-49fd-8e36-2d1756693ddb', 'baa1e8da-b4c2-4e6b-beb6-1f9050163691'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:02 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-82eb88e6-b995-449a-a626-c56493fafd17 tempest-ProjectMemberTests-825061873 None] Lock "cinder-eb562d13-549e-4f22-ba7c-5b8f17154d30-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:02 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-1c5f2553-3d45-431d-8e2c-f70cb5ad7067-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "cinder-1c5f2553-3d45-431d-8e2c-f70cb5ad7067-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09579ec-d0d5-49b1-83be-0fb5a58e88ff]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:03 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 Sep 01 02:26:03 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:03 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" returned: 0 in 0.371s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:03 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067 Sep 01 02:26:03 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:03 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-1c5f2553-3d45-431d-8e2c-f70cb5ad7067" released by "delete_volume" :: held 0.704s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Created reservations ['929e448a-ba7b-41a7-b2b7-b2a98b391afb', '0276b506-e472-4ead-934b-6e1815fda6ae', '7697604c-d510-4680-9da9-6ce39f0b87c3', '0fdef4ea-e56e-4d41-a300-dcdb55a51985'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:03 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:03 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:03 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:04 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.272s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:04 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-dfd53d75-8a6c-45ce-8f02-7ba1aa6b47be tempest-ProjectMemberTests-825061873 None] Lock "cinder-1c5f2553-3d45-431d-8e2c-f70cb5ad7067-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (c93681a8-b69d-4e91-9e2e-ba6373f7f4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a19e27a-2d60-4337-bb05-4a6f2d4804f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a19e27a-2d60-4337-bb05-4a6f2d4804f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634519258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c073a7-beaf-4f14-8eeb-3e3f3b5bd979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:05Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68266cde-1f9e-4968-bf94-c5a864fe1308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68266cde-1f9e-4968-bf94-c5a864fe1308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f516408-9bae-4319-8200-c328d128846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f516408-9bae-4319-8200-c328d128846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c073a7-beaf-4f14-8eeb-3e3f3b5bd979', 'volume_name': 'volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e510cfd8-9033-494b-99e4-e1404f002fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e510cfd8-9033-494b-99e4-e1404f002fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6f4b53-c790-49b1-85f0-3182bce25838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:04 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Volume 76c073a7-beaf-4f14-8eeb-3e3f3b5bd979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979', 'volume_size': 1} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634519258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c073a7-beaf-4f14-8eeb-3e3f3b5bd979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:05Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Creating volume 76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:04 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:26:04 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:04 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 1073741824 Sep 01 02:26:04 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:05 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 1073741824" returned: 0 in 0.439s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:05 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 Sep 01 02:26:05 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:05 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" returned: 0 in 0.269s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6f4b53-c790-49b1-85f0-3182bce25838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df48739a-176e-477b-8b66-4ed50343f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:05 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Volume volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 (76c073a7-beaf-4f14-8eeb-3e3f3b5bd979): created successfully Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df48739a-176e-477b-8b66-4ed50343f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:05 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (c93681a8-b69d-4e91-9e2e-ba6373f7f4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:05 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-a770a3aa-9246-4dbb-ab06-8426b26ce32e tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Creating offline snapshot 36e932c5-de0d-46ec-8fd7-92811e683858 of volume 76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5198dcb-1479-461d-822b-e20912c74029]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:06 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 Sep 01 02:26:06 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:06 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" returned: 0 in 0.406s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:06 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 1G Sep 01 02:26:06 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:06 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 1G" returned: 0 in 0.446s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:06 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:06 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 Sep 01 02:26:06 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:07 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858" returned: 0 in 0.314s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:07 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 is being set with open permissions: ugo+rw Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:07 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 Sep 01 02:26:07 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:07 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858" returned: 0 in 0.296s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:07 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info Sep 01 02:26:07 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:07 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info" returned: 0 in 0.280s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:07 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info is being set with open permissions: ugo+rw Sep 01 02:26:07 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:07 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info Sep 01 02:26:07 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:08 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.info" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:08 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:08 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b948fd88-3c12-4b7e-9be1-703a0c561d8e tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-36e932c5-de0d-46ec-8fd7-92811e683858-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-36e932c5-de0d-46ec-8fd7-92811e683858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-36e932c5-de0d-46ec-8fd7-92811e683858" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-36e932c5-de0d-46ec-8fd7-92811e683858" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot 36e932c5-de0d-46ec-8fd7-92811e683858 of volume 76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a77dd7-2224-4b49-8b95-3633451631e6]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:09 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 Sep 01 02:26:09 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:09 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858" returned: 0 in 0.407s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd5b71d-b7b1-439d-9523-ea12c6722489]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:09 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:09 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 Sep 01 02:26:09 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:10 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" returned: 0 in 0.360s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:10 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 Sep 01 02:26:10 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=172,cinder:UPDATE=221,cinder:INSERT=49,cinder:DELETE=18 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=167,cinder:UPDATE=223,cinder:INSERT=71,cinder:DELETE=20 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Flow 'volume_create_manager' (d05ed539-1ddb-4f55-86e6-c34cfc235ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f05fc-14ec-4fb0-911f-5f71f35b4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f05fc-14ec-4fb0-911f-5f71f35b4497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-815863224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbac0732-cb2c-447e-acaa-ad7a799d5c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc371b4b7f6431e99f580a7374f20a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:10Z,use_quota=True,user_id='e50ee729f9a6456cb9ff20e6ecf88a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f259d969-3578-4d6a-9140-615e71547961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f259d969-3578-4d6a-9140-615e71547961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c5ead-2b8a-4923-ad73-60d4252b2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c5ead-2b8a-4923-ad73-60d4252b2a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbac0732-cb2c-447e-acaa-ad7a799d5c68', 'volume_name': 'volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8719249a-d10e-4aff-b4cd-6053445458a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8719249a-d10e-4aff-b4cd-6053445458a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a3e31e-95a6-4741-aa4c-470372a3ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:10 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Volume fbac0732-cb2c-447e-acaa-ad7a799d5c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68', 'volume_size': 1} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-815863224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbac0732-cb2c-447e-acaa-ad7a799d5c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc371b4b7f6431e99f580a7374f20a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:10Z,use_quota=True,user_id='e50ee729f9a6456cb9ff20e6ecf88a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Creating volume fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:10 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:10 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 1073741824 Sep 01 02:26:10 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:10 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858" returned: 0 in 0.340s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:10 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858 Sep 01 02:26:10 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:10 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979.36e932c5-de0d-46ec-8fd7-92811e683858" returned: 0 in 0.243s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-36e932c5-de0d-46ec-8fd7-92811e683858" released by "_delete_snapshot" :: held 1.449s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" released by "delete_snapshot" :: held 1.484s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Created reservations ['ee8c421f-53a0-438b-a7e5-2381e7967aca', 'b795ed3d-6d80-475e-9f45-808cb8951998', '5a05bece-04dc-4990-8f82-3dd1d7378729', 'c664eb8e-0683-4d5e-b421-44b2b6c39e7c'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:10 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:26:10 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 1073741824" returned: 0 in 0.453s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-156e58d2-2970-4949-93a1-00d701a633d0 tempest-ProjectMemberTests-825061873 None] Lock "cinder-36e932c5-de0d-46ec-8fd7-92811e683858-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:10 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:11 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:11 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:11 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.234s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a3e31e-95a6-4741-aa4c-470372a3ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1700f5-b298-4e33-832c-0e2822a4189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:11 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Volume volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 (fbac0732-cb2c-447e-acaa-ad7a799d5c68): created successfully Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1700f5-b298-4e33-832c-0e2822a4189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Flow 'volume_create_manager' (d05ed539-1ddb-4f55-86e6-c34cfc235ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:11 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-41021820-d95b-4ff6-bb0f-732c3e62b6b6 tempest-SnapshotDependencyTests-1941216082 None] Created volume successfully. Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "cinder-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" acquired by "delete_volume" :: waited 0.016s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb089b5-9ab3-4b6d-a6b0-947d7f7355dd]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Creating offline snapshot 7a134234-6ea1-4f91-8079-6e699d9d0a53 of volume fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a8994-7605-4593-b112-c5bbf6675e4b]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:11 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:11 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 Sep 01 02:26:11 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:11 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:11 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:11 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" returned: 0 in 0.390s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:12 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979 Sep 01 02:26:12 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:12 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.372s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:12 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 1G Sep 01 02:26:12 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:12 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" returned: 0 in 0.273s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979" released by "delete_volume" :: held 0.731s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Created reservations ['eca8a416-cfc3-4060-8439-81bbf3896471', '2e80d0cc-771a-4e4d-8075-6ab85c1cc128', '79399dfc-bbbd-47dd-9827-057bda53bac9', '2fdf7de9-bc01-4324-ae03-b53c6f8df37a'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:12 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:12 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:12 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 1G" returned: 0 in 0.418s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:12 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:12 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:12 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.252s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:12 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-26a6df2a-de5d-4641-823d-11627615c68c tempest-ProjectMemberTests-825061873 None] Lock "cinder-76c073a7-beaf-4f14-8eeb-3e3f3b5bd979-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:12 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.296s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:12 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 is being set with open permissions: ugo+rw Sep 01 02:26:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:12 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:12 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:13 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.237s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:13 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info Sep 01 02:26:13 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (922422aa-a5e9-4da6-8ee8-4179294cdddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11b19bf-81c2-4eb8-b746-bfd221d9aedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11b19bf-81c2-4eb8-b746-bfd221d9aedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014888898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29ec2d3-6eb4-47c1-a616-861eaba7d309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:13Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8230f8-dcb3-443a-bb91-318f8fc9b33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8230f8-dcb3-443a-bb91-318f8fc9b33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a152af0-3593-4524-8b76-3a418e41ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a152af0-3593-4524-8b76-3a418e41ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29ec2d3-6eb4-47c1-a616-861eaba7d309', 'volume_name': 'volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8478c708-b589-449e-8f05-2e67271da792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8478c708-b589-449e-8f05-2e67271da792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975a3868-dddc-48d0-9997-6f3fad88a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:13 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Volume b29ec2d3-6eb4-47c1-a616-861eaba7d309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309', 'volume_size': 1} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:13 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info" returned: 0 in 0.254s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:13 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info is being set with open permissions: ugo+rw Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:13 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info Sep 01 02:26:13 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:13 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.info" returned: 0 in 0.244s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014888898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29ec2d3-6eb4-47c1-a616-861eaba7d309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf0b1d294254b5da9182026f6c13653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:13Z,use_quota=True,user_id='1472535e229447769cc691a6f98d6d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Creating volume b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:13 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:26:13 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:13 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 1073741824 Sep 01 02:26:13 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-84cd2465-5fd6-4ffa-8b35-b85181a40a91 tempest-SnapshotDependencyTests-1941216082 None] Create snapshot completed successfully Sep 01 02:26:14 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 1073741824" returned: 0 in 0.424s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:14 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 Sep 01 02:26:14 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:14 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975a3868-dddc-48d0-9997-6f3fad88a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00421336-b868-4eff-b4cc-fc4404cf0e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Volume volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 (b29ec2d3-6eb4-47c1-a616-861eaba7d309): created successfully Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00421336-b868-4eff-b4cc-fc4404cf0e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Flow 'volume_create_manager' (922422aa-a5e9-4da6-8ee8-4179294cdddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:14 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d9c668ee-1ca9-44c5-98d0-3e24c8adad84 tempest-ProjectMemberTests-825061873 None] Created volume successfully. Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Flow 'volume_create_manager' (0ee91003-316b-46d9-859c-1de9093140e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb2ffd4-b85f-41db-99ef-b8b81ca0884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb2ffd4-b85f-41db-99ef-b8b81ca0884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c785f8b5-0203-4de5-8f59-06f6a0c10c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc371b4b7f6431e99f580a7374f20a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a134234-6ea1-4f91-8079-6e699d9d0a53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:14Z,use_quota=True,user_id='e50ee729f9a6456cb9ff20e6ecf88a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3309577f-ff81-4a2e-91fd-5e45106d334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3309577f-ff81-4a2e-91fd-5e45106d334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78da50b-70b2-46d9-8b36-c875f24938b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78da50b-70b2-46d9-8b36-c875f24938b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c785f8b5-0203-4de5-8f59-06f6a0c10c30', 'volume_name': 'volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30', 'volume_size': 1, 'snapshot_id': '7a134234-6ea1-4f91-8079-6e699d9d0a53'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee183b-a0fc-41fe-b8ff-9b0a2e2c110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee183b-a0fc-41fe-b8ff-9b0a2e2c110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a437b-f311-498f-8e90-99f2ab5a2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:14 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Volume c785f8b5-0203-4de5-8f59-06f6a0c10c30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30', 'volume_size': 1, 'snapshot_id': '7a134234-6ea1-4f91-8079-6e699d9d0a53'} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53-c785f8b5-0203-4de5-8f59-06f6a0c10c30" by "_create_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53-c785f8b5-0203-4de5-8f59-06f6a0c10c30" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Creating volume c785f8b5-0203-4de5-8f59-06f6a0c10c30 from snapshot 7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" by "_copy_volume_from_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] snapshot: 7a134234-6ea1-4f91-8079-6e699d9d0a53, volume: c785f8b5-0203-4de5-8f59-06f6a0c10c30, {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[019aecd2-acae-44f4-b13d-4b32a24b3016]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:14 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:14 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:14 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:15 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.344s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac41b4-92c3-4e40-93a7-31b4feecb038]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:15 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:15 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:15 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.398s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Creating direct copy from snapshot {{(pid=86925) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG cinder.utils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Path /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 not found in is_blk_device check {{(pid=86925) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:15 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:15 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 Sep 01 02:26:15 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:19 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30" returned: 0 in 4.010s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Image conversion details: src /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 {{(pid=86925) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:26:19 devstack cinder-volume[86925]: INFO cinder.image.image_utils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Converted 1024.00 MB image at 255.27 MB/s Sep 01 02:26:19 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 is being set with open permissions: ugo+rw Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:19 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 Sep 01 02:26:19 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:19 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" released by "_copy_volume_from_snapshot" :: held 5.089s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53-c785f8b5-0203-4de5-8f59-06f6a0c10c30" released by "_create_volume_from_snapshot" :: held 5.148s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.162s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.287s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Creating offline snapshot a1d2615e-8f74-42e8-b617-c309af389470 of volume b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a437b-f311-498f-8e90-99f2ab5a2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30', 'volume_size': 1, 'snapshot_id': '7a134234-6ea1-4f91-8079-6e699d9d0a53'}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cac8238-4949-4537-9e32-cfa41e70edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35232a7-4a06-4564-8091-521a9be28fad]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:19 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Volume volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 (c785f8b5-0203-4de5-8f59-06f6a0c10c30): created successfully Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cac8238-4949-4537-9e32-cfa41e70edbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Flow 'volume_create_manager' (0ee91003-316b-46d9-859c-1de9093140e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:19 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-c2762712-741b-4d4f-8ace-e9fae7ed7246 tempest-SnapshotDependencyTests-1941216082 None] Created volume successfully. Sep 01 02:26:19 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 Sep 01 02:26:19 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-7a134234-6ea1-4f91-8079-6e699d9d0a53-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-7a134234-6ea1-4f91-8079-6e699d9d0a53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:19 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Deleting offline snapshot 7a134234-6ea1-4f91-8079-6e699d9d0a53 of volume fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] snapshot_file for this snap is: volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b4a75-dda9-48b6-aeec-2058c650e4d0]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:20 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309" returned: 0 in 0.379s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 1G {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:20 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:20 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:20 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 1G Sep 01 02:26:20 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:20 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.362s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a847cd-de32-498a-8441-006d916f3d7d]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:20 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 1G" returned: 0 in 0.382s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:20 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:20 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:20 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 Sep 01 02:26:20 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:20 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 -F qcow2 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470" returned: 0 in 0.287s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:20 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 is being set with open permissions: ugo+rw Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:20 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 Sep 01 02:26:20 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:20 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.532s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:20 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:21 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:21 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:21 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470" returned: 0 in 0.265s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:21 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info Sep 01 02:26:21 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:21 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.329s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:21 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53 Sep 01 02:26:21 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:21 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info" returned: 0 in 0.264s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:21 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.remotefs [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info is being set with open permissions: ugo+rw Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:21 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info Sep 01 02:26:21 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:21 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68.7a134234-6ea1-4f91-8079-6e699d9d0a53" returned: 0 in 0.239s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-7a134234-6ea1-4f91-8079-6e699d9d0a53" released by "_delete_snapshot" :: held 1.557s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" released by "delete_snapshot" :: held 1.581s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:21 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.info" returned: 0 in 0.258s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Created reservations ['dc863d15-0075-443b-9bf3-3edcae789470', '321c611c-8b47-4692-8dd2-fbc902479a63', '44c667e3-bcc4-4311-9823-791e0f173342', '0e805c62-2b50-4247-ae52-c1f40e870549'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-dc7440eb-3f5b-40bc-bc50-da12cafbfd21 tempest-ProjectMemberTests-825061873 None] Create snapshot completed successfully Sep 01 02:26:21 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Delete snapshot completed successfully. Sep 01 02:26:21 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eec00e22-3072-48fc-afa1-fb17e82e5f59 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-7a134234-6ea1-4f91-8079-6e699d9d0a53-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-a1d2615e-8f74-42e8-b617-c309af389470-delete_snapshot" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-fbac0732-cb2c-447e-acaa-ad7a799d5c68-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-fbac0732-cb2c-447e-acaa-ad7a799d5c68-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-a1d2615e-8f74-42e8-b617-c309af389470-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" by "delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-a1d2615e-8f74-42e8-b617-c309af389470" by "_delete_snapshot" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a1d2615e-8f74-42e8-b617-c309af389470" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Deleting offline snapshot a1d2615e-8f74-42e8-b617-c309af389470 of volume b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] snapshot_file for this snap is: volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[9301eed0-cbdd-45cd-945c-54c88d77f493]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" acquired by "delete_volume" :: waited 0.022s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d55a25-b30e-41db-881b-14b7e9164b5a]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:22 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 Sep 01 02:26:22 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:22 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:22 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:22 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470" returned: 0 in 0.351s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86925) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c2d0f-198a-4710-b750-4d89652a25c5]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:22 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.357s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:22 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68 Sep 01 02:26:22 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:22 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 Sep 01 02:26:22 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:22 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-fbac0732-cb2c-447e-acaa-ad7a799d5c68" returned: 0 in 0.235s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-fbac0732-cb2c-447e-acaa-ad7a799d5c68" released by "delete_volume" :: held 0.643s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Created reservations ['43491240-f161-4056-976d-9bd48f81be59', '3b30fcc5-6cad-4c04-a79a-805c4eb57e33', 'a07ba74f-bff1-4b79-bb74-09ff363d8afe', 'f9eac541-a342-4375-b441-34d0ce67219d'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:22 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309" returned: 0 in 0.353s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:22 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:22 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 Sep 01 02:26:22 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:23 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:23 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:23 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.250s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Deleted volume successfully. Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-9a3a79af-bc2e-4e37-977a-23a314b1047b tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-fbac0732-cb2c-447e-acaa-ad7a799d5c68-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-c785f8b5-0203-4de5-8f59-06f6a0c10c30-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:23 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470" returned: 0 in 0.383s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-c785f8b5-0203-4de5-8f59-06f6a0c10c30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:23 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470 Sep 01 02:26:23 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d438410-a869-4b30-8ce8-9bd929fcbae4]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:23 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 Sep 01 02:26:23 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:23 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309.a1d2615e-8f74-42e8-b617-c309af389470" returned: 0 in 0.266s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-a1d2615e-8f74-42e8-b617-c309af389470" released by "_delete_snapshot" :: held 1.453s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" released by "delete_snapshot" :: held 1.484s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Created reservations ['c4e6b6e7-b476-4300-822f-0d1f9f3ee1f2', '7dea9989-9b67-4906-b655-b11ca3b19cb7', '7aad903c-d930-433c-a95f-d409ef501ccb', '1a1670ff-e3a9-4002-847a-3b8ce8672809'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:23 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Delete snapshot completed successfully. Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-b843be7d-5831-473c-b664-4d213a6ebcf7 tempest-ProjectMemberTests-825061873 None] Lock "cinder-a1d2615e-8f74-42e8-b617-c309af389470-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:23 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30" returned: 0 in 0.366s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:23 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:23 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30 Sep 01 02:26:23 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:24 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-c785f8b5-0203-4de5-8f59-06f6a0c10c30" returned: 0 in 0.246s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-quobyte-c785f8b5-0203-4de5-8f59-06f6a0c10c30" released by "delete_volume" :: held 0.651s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Created reservations ['808f429c-8eec-4812-b4de-4e57c63ef6e9', '32335e26-3add-494e-845f-52a4acf2e1a6', '55be011f-14d9-4ed8-b260-838ed3b3a5bd', '6d5a0f3d-a175-4b3f-93e5-78693f32c210'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:24 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:24 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-b29ec2d3-6eb4-47c1-a616-861eaba7d309-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "cinder-b29ec2d3-6eb4-47c1-a616-861eaba7d309-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Acquiring lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ef25f-718d-46e5-af8c-15a4d9ea4792]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:24 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.267s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:24 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Deleted volume successfully. Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-eda5df2d-06b6-4b44-8812-f0d14959a950 tempest-SnapshotDependencyTests-1941216082 None] Lock "cinder-c785f8b5-0203-4de5-8f59-06f6a0c10c30-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:24 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 Sep 01 02:26:24 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:24 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309" returned: 0 in 0.374s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:24 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:24 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309 Sep 01 02:26:24 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:25 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-b29ec2d3-6eb4-47c1-a616-861eaba7d309" returned: 0 in 0.253s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "cinder-quobyte-b29ec2d3-6eb4-47c1-a616-861eaba7d309" released by "delete_volume" :: held 0.698s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Created reservations ['b10323be-652a-4bf6-9fca-ed83443083bf', 'f9ffc2da-8c11-41c6-887b-fe13cb326190', 'fc4f3cb0-a678-489b-a3d7-5cbf523c1cc2', '76aa270f-4c36-422d-b07a-c6cdac8e89f5'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:25 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:25 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:25 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.287s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:25 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Deleted volume successfully. Sep 01 02:26:25 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-91785322-f677-47e5-a67b-93b17904456b tempest-ProjectMemberTests-825061873 None] Lock "cinder-b29ec2d3-6eb4-47c1-a616-861eaba7d309-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Flow 'volume_create_manager' (288a1726-aede-4165-a4e6-1afd24c1ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0b2058-2ca7-4bb1-8655-47138cc35453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0b2058-2ca7-4bb1-8655-47138cc35453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132918657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a0b32-8810-42fa-b7b2-1d1f5276f87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500dbca119f46809bf09b56741bd101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:37Z,use_quota=True,user_id='adf5633449df43469a627a03b39a3318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685da99d-09ff-4c9c-ad96-f49ce5cdd949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685da99d-09ff-4c9c-ad96-f49ce5cdd949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8049-0128-431e-a612-4edd3ef1cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8049-0128-431e-a612-4edd3ef1cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264a0b32-8810-42fa-b7b2-1d1f5276f87f', 'volume_name': 'volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d973e5-a170-4276-9d8c-4f15746c7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d973e5-a170-4276-9d8c-4f15746c7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb63489-4f46-42a9-8b78-5ce638c27724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:37 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Volume 264a0b32-8810-42fa-b7b2-1d1f5276f87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f', 'volume_size': 1} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132918657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a0b32-8810-42fa-b7b2-1d1f5276f87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500dbca119f46809bf09b56741bd101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:37Z,use_quota=True,user_id='adf5633449df43469a627a03b39a3318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Creating volume 264a0b32-8810-42fa-b7b2-1d1f5276f87f {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:37 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:37 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f 1073741824 Sep 01 02:26:37 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:37 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f 1073741824" returned: 0 in 0.373s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:37 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:37 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f Sep 01 02:26:37 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:38 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f" returned: 0 in 0.231s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] <== create_volume: return (641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb63489-4f46-42a9-8b78-5ce638c27724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b58a3b-9d0f-4049-abe3-fd028658a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:38 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Volume volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f (264a0b32-8810-42fa-b7b2-1d1f5276f87f): created successfully Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b58a3b-9d0f-4049-abe3-fd028658a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Flow 'volume_create_manager' (288a1726-aede-4165-a4e6-1afd24c1ec17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:38 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-9247cbe5-a4f7-4ff1-bef7-cbd2aa1ada8a tempest-ProjectReaderTests-923867928 None] Created volume successfully. Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Acquiring lock "cinder-264a0b32-8810-42fa-b7b2-1d1f5276f87f-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "cinder-264a0b32-8810-42fa-b7b2-1d1f5276f87f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Acquiring lock "cinder-quobyte-264a0b32-8810-42fa-b7b2-1d1f5276f87f" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "cinder-quobyte-264a0b32-8810-42fa-b7b2-1d1f5276f87f" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2bae1-3996-4a5d-8025-6537a9648efc]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:38 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f Sep 01 02:26:38 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:38 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f" returned: 0 in 0.326s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:38 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:38 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f Sep 01 02:26:38 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:39 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-264a0b32-8810-42fa-b7b2-1d1f5276f87f" returned: 0 in 0.227s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "cinder-quobyte-264a0b32-8810-42fa-b7b2-1d1f5276f87f" released by "delete_volume" :: held 0.587s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Created reservations ['ff3dc891-8dee-434a-94f3-51db60bf305a', '662e3b06-d246-483a-955b-94aaa4478e93', '5bf170fa-b95b-4c56-a30c-45c8e496a54f', '2f33294e-13c9-4e90-b111-6b8b31c8c7ad'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:39 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:39 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:39 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.227s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:39 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Deleted volume successfully. Sep 01 02:26:39 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-af37eca8-e5f8-4b1b-abb6-064d43c18fff tempest-ProjectReaderTests-923867928 None] Lock "cinder-264a0b32-8810-42fa-b7b2-1d1f5276f87f-delete_volume" released by "delete_volume" :: held 0.992s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.flows.manager.create_volume [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86925) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Flow 'volume_create_manager' (75ad2fb9-b855-4c7f-84d7-0f0a3b607374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edcca30-b7f2-41cf-965c-50b83b68ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edcca30-b7f2-41cf-965c-50b83b68ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325362782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d755916-0758-403e-adde-056fd289ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500dbca119f46809bf09b56741bd101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:40Z,use_quota=True,user_id='adf5633449df43469a627a03b39a3318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33b46-d7f5-4ab3-afb5-fff50bbaabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33b46-d7f5-4ab3-afb5-fff50bbaabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80831256-9232-452c-a3bb-26c3eda2a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80831256-9232-452c-a3bb-26c3eda2a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d755916-0758-403e-adde-056fd289ebbd', 'volume_name': 'volume-4d755916-0758-403e-adde-056fd289ebbd', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae2570c-ecd1-4893-a569-7d794cd9babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae2570c-ecd1-4893-a569-7d794cd9babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace58ab-7cae-449d-9645-7fff02b96485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Volume 4d755916-0758-403e-adde-056fd289ebbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d755916-0758-403e-adde-056fd289ebbd', 'volume_size': 1} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325362782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d755916-0758-403e-adde-056fd289ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500dbca119f46809bf09b56741bd101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:26:40Z,use_quota=True,user_id='adf5633449df43469a627a03b39a3318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c534af09-061e-4b9f-a444-02bfbe4041aa),volume_type_id=c534af09-061e-4b9f-a444-02bfbe4041aa)}" {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Creating volume 4d755916-0758-403e-adde-056fd289ebbd {{(pid=86925) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Selected osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 as target Quobyte volume. {{(pid=86925) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:26:40 devstack cinder-volume[86925]: INFO cinder.volume.drivers.remotefs [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] casted to osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95 Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd 1073741824 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:40 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd 1073741824 Sep 01 02:26:40 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:40 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd 1073741824" returned: 0 in 0.366s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:40 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd Sep 01 02:26:40 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:40 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd" returned: 0 in 0.233s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] <== create_volume: return (635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'} {{(pid=86925) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.637s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace58ab-7cae-449d-9645-7fff02b96485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d755916-0758-403e-adde-056fd289ebbd', 'volume_size': 1}' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f022d-bb34-42a5-8c74-b689277df5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:26:40 devstack cinder-volume[86925]: INFO cinder.volume.flows.manager.create_volume [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Volume volume-4d755916-0758-403e-adde-056fd289ebbd (4d755916-0758-403e-adde-056fd289ebbd): created successfully Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f022d-bb34-42a5-8c74-b689277df5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86925) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Flow 'volume_create_manager' (75ad2fb9-b855-4c7f-84d7-0f0a3b607374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86925) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:26:40 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-412f840a-37cb-450b-afd9-61fbfd42574a tempest-ProjectReaderTests-923867928 None] Created volume successfully. Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:40 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:40 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:40 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:41 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_service.periodic_task [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] Running periodic task VolumeManager._thread_info {{(pid=86925) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread count: 28 {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-b0337542-79e9-4cd6-bec2-ae2b4360f8f3 None None] thread info: [<_MainThread(MainThread, started 126370961293440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86925) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Acquiring lock "cinder-4d755916-0758-403e-adde-056fd289ebbd-delete_volume" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "cinder-4d755916-0758-403e-adde-056fd289ebbd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Acquiring lock "cinder-quobyte-4d755916-0758-403e-adde-056fd289ebbd" by "delete_volume" {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "cinder-quobyte-4d755916-0758-403e-adde-056fd289ebbd" acquired by "delete_volume" :: waited 0.012s {{(pid=86925) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54cd1a0-00b8-4d42-af20-8342a88003f9]: (4, 'qcow2') {{(pid=87892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:41 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd Sep 01 02:26:41 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:41 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd" returned: 0 in 0.334s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:41 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd Sep 01 02:26:41 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:41 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391/volume-4d755916-0758-403e-adde-056fd289ebbd" returned: 0 in 0.236s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "cinder-quobyte-4d755916-0758-403e-adde-056fd289ebbd" released by "delete_volume" :: held 0.603s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.quota [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Created reservations ['a295bfc8-0d94-40c5-882a-024b80ff2ec5', 'e135f6f8-fc08-4eea-98e9-eea71176c48b', '7a5161d1-6a7c-4e39-93b8-2a4289be4584', '347f67f2-53c1-4a57-a2a5-1663c85012df'] {{(pid=86925) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f94bf257-a313-4502-a374-af436e1c6e95'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:41 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:41 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391 Sep 01 02:26:41 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:42 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:42 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3039784a7b86480550bc8bb95acb2391" returned: 0 in 0.230s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:42 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:42 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Deleted volume successfully. Sep 01 02:26:42 devstack cinder-volume[86925]: DEBUG cinder.coordination [None req-8c53649c-a6a2-4e9b-bfd9-b0be7e2ed749 tempest-ProjectReaderTests-923867928 None] Lock "cinder-4d755916-0758-403e-adde-056fd289ebbd-delete_volume" released by "delete_volume" :: held 1.004s {{(pid=86925) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:26:51 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:26:52 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=59,cinder:INSERT=26,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}